-- Logs begin at Thu 2022-07-28 21:06:10 UTC, end at Thu 2022-07-28 22:36:40 UTC. -- Jul 28 22:01:11.575067 dv-cinder-850939-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 22:01:11.582965 dv-cinder-850939-3-smb devstack@keystone.service[80481]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 22:01:11 2022] *** Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: nodename: dv-cinder-850939-3-smb Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: machine: x86_64 Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: clock source: unix Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: pcre jit disabled Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: detected number of CPU cores: 4 Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: current working directory: / Jul 28 22:01:11.584939 dv-cinder-850939-3-smb devstack@keystone.service[80481]: detected binary path: /usr/bin/uwsgi-core Jul 28 22:01:11.585459 dv-cinder-850939-3-smb devstack@keystone.service[80481]: your processes number limit is 47680 Jul 28 22:01:11.585459 dv-cinder-850939-3-smb devstack@keystone.service[80481]: your memory page size is 4096 bytes Jul 28 22:01:11.585459 dv-cinder-850939-3-smb devstack@keystone.service[80481]: detected max file descriptor number: 2048 Jul 28 22:01:11.585459 dv-cinder-850939-3-smb devstack@keystone.service[80481]: lock engine: pthread robust mutexes Jul 28 22:01:11.585459 dv-cinder-850939-3-smb devstack@keystone.service[80481]: thunder lock: enabled Jul 28 22:01:11.585459 dv-cinder-850939-3-smb devstack@keystone.service[80481]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 22:01:11.585459 dv-cinder-850939-3-smb devstack@keystone.service[80481]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 22:01:11.624048 dv-cinder-850939-3-smb devstack@keystone.service[80481]: Python main interpreter initialized at 0x55ef6385a9c0 Jul 28 22:01:11.624048 dv-cinder-850939-3-smb devstack@keystone.service[80481]: python threads support enabled Jul 28 22:01:11.624048 dv-cinder-850939-3-smb devstack@keystone.service[80481]: your server socket listen backlog is limited to 100 connections Jul 28 22:01:11.624048 dv-cinder-850939-3-smb devstack@keystone.service[80481]: your mercy for graceful operations on workers is 90 seconds Jul 28 22:01:11.624388 dv-cinder-850939-3-smb devstack@keystone.service[80481]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 22:01:11.624462 dv-cinder-850939-3-smb devstack@keystone.service[80481]: *** Operational MODE: preforking *** Jul 28 22:01:11.624728 dv-cinder-850939-3-smb devstack@keystone.service[80481]: *** uWSGI is running in multiple interpreter mode *** Jul 28 22:01:11.624728 dv-cinder-850939-3-smb devstack@keystone.service[80481]: spawned uWSGI master process (pid: 80481) Jul 28 22:01:11.624921 dv-cinder-850939-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 22:01:11.625629 dv-cinder-850939-3-smb devstack@keystone.service[80481]: spawned uWSGI worker 1 (pid: 80487, cores: 1) Jul 28 22:01:11.630289 dv-cinder-850939-3-smb devstack@keystone.service[80481]: spawned uWSGI worker 2 (pid: 80488, cores: 1) Jul 28 22:01:11.630289 dv-cinder-850939-3-smb devstack@keystone.service[80481]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 22:01:17.116379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:01:17.116379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: from cryptography.utils import int_from_bytes Jul 28 22:01:17.117148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:01:17.117148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: from cryptography.utils import int_from_bytes Jul 28 22:01:17.124692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:01:17.124692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: from cryptography.utils import int_from_bytes Jul 28 22:01:17.125141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 22:01:17.125141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: from cryptography.utils import int_from_bytes Jul 28 22:01:17.167245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 22:01:17.167436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 22:01:17.167628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] command line args: [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 22:01:17.167906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 22:01:17.168085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ================================================================================ {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 22:01:17.168338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] admin_token = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.168585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] config_dir = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.168773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.168955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] config_source = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.169136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] debug = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.169336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.170678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.170678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.170678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.170678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.170678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] list_limit = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.170948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] log_config_append = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.170948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.171164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] log_dir = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.171248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] log_file = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.171492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.171723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.171965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.172211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.172388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.172565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.172809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.172933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 22:01:17.173057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 22:01:17.173169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.173287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] command line args: [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 22:01:17.173404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.173521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 22:01:17.173642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.173760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ================================================================================ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 22:01:17.173879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.173990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] admin_token = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config_dir = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] config_source = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] debug = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.174920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] publish_errors = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.175983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176329 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_config_append = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_dir = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.176928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] standard_threads = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] use_journal = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.177979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] use_json = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] use_stderr = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] use_syslog = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.178908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.179018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.179130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.179257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.179377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.179496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.179607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.179723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.179835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.179945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.180120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.180236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.180353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.180465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.180581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.180702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.180702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.180918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.181042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.181163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] publish_errors = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.181277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.181393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.181504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.181621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.181733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.181851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.181963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.182074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.182190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.182314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.182314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] standard_threads = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.182534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.182648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.182759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.182868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.182985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.183101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.183223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.183337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_journal = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.183337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_json = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.183549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.183661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_stderr = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.183777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.183898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] use_syslog = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.184010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.184120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 22:01:17.184231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.184341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.184460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.184580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.184699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.184815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.184932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.185918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.186909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.187940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.188963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.189952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.190968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.191993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192228 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.192902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.193974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.194086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.194279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.194400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.194993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.195965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.196098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.196317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.196454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.196571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.196704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.196818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.196931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.197962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.198904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.199947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.200965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.201977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.202095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.202208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.202361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.202473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.202665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.202782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.202894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203825 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.203946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] auth.external = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] auth.password = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.204987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] auth.token = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.205900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.206936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] credential.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.207905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.208961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209188 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.external = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.209967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.210730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.210868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.password = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.210985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] auth.token = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.211912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.212962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.213997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.214960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.215999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.216933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.217126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.217250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.217364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.217555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.217675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.217788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.217910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.218973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.219916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.220946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.221992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.222963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.223977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.224995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.225946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.226885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.227912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228765 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.228886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.229931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.230909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.231992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.232919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.233961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.234930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.235969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.236997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] role.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] role.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.237915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238151 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.238864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.239925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.240956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.241157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.241270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.241436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.241552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.241672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.241788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.241901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.242966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243194 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.243999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.244942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.245980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246821 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.246935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.247972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.248883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.connection = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.249942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250765 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.250991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.251902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.252937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.253050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.253163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.253278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.253403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.253518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.253632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.253989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.254478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.255397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.255397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.255397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.255397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.255397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.255397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.255397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.256147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.256147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.256147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.256147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.256595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.256595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 22:01:17.256812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 22:01:17.281165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.281397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.281627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.281990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.282225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.282474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.290057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.293408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.320068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.320294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.326738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.326975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.373253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.373803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.426755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.426979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.430783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.431201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.492246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.492466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.492692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.492915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.493094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.493181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.493328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.493410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.493552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.493772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.493989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.494204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.517140 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.517373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.517479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.517600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.517683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.517827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.517908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.518074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.518156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.518275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.518356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.518495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.518575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.518767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.530102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.530489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.542796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.543991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.544126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.544204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.544342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 22:01:17.561589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.561798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 22:01:17.562135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.562220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.562352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 22:01:17.562431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 22:01:17.562619 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.562739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.562878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.562959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 22:01:17.563136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.563218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.563389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.563469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.563644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.563899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.573593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.573869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.574134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.574213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.574437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.574533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.574737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.575018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.581318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.581925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.586055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.586372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.586636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.586716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.586914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.587972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.588053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.588236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.588315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.588503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.588583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.588765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.588844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.589030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.589292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.611715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.612257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.613203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.613484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.613744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.614027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.618741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.619018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.619190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.619299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.619468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.619745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.625984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.626225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.626396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.626676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.631134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.631225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.631426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.631508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.631706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.631787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.632573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.632660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.632853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.632935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.633127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.633209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.633390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.633469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.633668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.633784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.649638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.649733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.649914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.649995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.653853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.653937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.657022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.657111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.657327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.657420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.661732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.661821 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.664976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.665067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.668182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.668275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.668476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.668558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.668759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.668839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.669041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.669121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.669315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.669396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.669597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.669687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.686118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.686213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.686422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.686505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.686683 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.686764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.686943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.687024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.693806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.693966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.695929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.696058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.696239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.696329 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.699003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.699098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.699281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.699371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.699578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.699660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.699857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.699939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.700140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.700222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.711767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.712044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.712324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.712516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.712598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.712798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.712881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.713079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.713161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.713356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.713438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.713633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.713903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.714175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.729031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.729893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.732029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.732897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.735887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.736007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.737483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.738356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.739004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.739287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.739564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.739877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.740157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.740435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.746820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.747468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.748296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.749079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.751246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.751534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.751813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.752043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.752124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.752332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.752615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.752901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.761054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.761342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.761623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.761826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.762115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.762430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.768517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.768798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.769078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.769323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 22:01:17.769457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.769602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.769743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.769880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.770020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.770160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.770322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.770468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.770594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.770757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.770875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.771031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.771160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.771309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.771439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.771686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.771765 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.771965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.772053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.772220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.772299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.772500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.772792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.773048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 22:01:17.806125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef6385a9c0 pid: 80488 (default app) Jul 28 22:01:17.806940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef6385a9c0 pid: 80487 (default app) Jul 28 22:01:17.809511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e642235-71eb-4c92-88b4-09c6cf2f6da8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:17.809801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e642235-71eb-4c92-88b4-09c6cf2f6da8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:17.810080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e642235-71eb-4c92-88b4-09c6cf2f6da8 None None] PATH_INFO: `/v3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:17.814224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu Jul 28 22:01:17 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:25.375308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f8e1-9f54-48a4-923a-f2bdbeb44694 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:25.375852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f8e1-9f54-48a4-923a-f2bdbeb44694 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:25.375852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477f8e1-9f54-48a4-923a-f2bdbeb44694 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:25.380518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:01:25.386192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:25.386701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:25.386801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:25.457653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: INFO dbcounter [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] Registered counter for database keystone Jul 28 22:01:25.478796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG oslo_db.sqlalchemy.engines [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:01:25.484887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writer thread running {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:01:25.662759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG passlib.handlers.bcrypt [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80488) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 22:01:25.663612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG passlib.handlers.bcrypt [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80488) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 22:01:25.716929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:25.718546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:25.849172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 22:01:25.991907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477f8e1-9f54-48a4-923a-f2bdbeb44694 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:26.060657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: INFO dbcounter [None req-0477f8e1-9f54-48a4-923a-f2bdbeb44694 None None] Registered counter for database keystone Jul 28 22:01:26.079248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG oslo_db.sqlalchemy.engines [None req-0477f8e1-9f54-48a4-923a-f2bdbeb44694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 22:01:26.085928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writer thread running {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 22:01:26.204810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477f8e1-9f54-48a4-923a-f2bdbeb44694 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:26.209141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf9fe-cde6-4186-bd47-ffce949b0300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:26.209792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf9fe-cde6-4186-bd47-ffce949b0300 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:26.210698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf9fe-cde6-4186-bd47-ffce949b0300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:26.210973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf9fe-cde6-4186-bd47-ffce949b0300 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:26.218951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf9fe-cde6-4186-bd47-ffce949b0300 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:26.270016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6baf9fe-cde6-4186-bd47-ffce949b0300 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 22:01:26.270326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf9fe-cde6-4186-bd47-ffce949b0300 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:26.280342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jul 28 22:01:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 22:01:26.286315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:26.300432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09273b09-9bb2-4d8a-95ba-f407a9b71338 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:26.304884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b4c94-5af0-4510-a633-aafbd4fbf3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:26.305976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b4c94-5af0-4510-a633-aafbd4fbf3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:26.306287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b4c94-5af0-4510-a633-aafbd4fbf3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:26.306571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b4c94-5af0-4510-a633-aafbd4fbf3d1 admin admin] PATH_INFO: `/v3/projects/8855a1173a1b45fb8e20b8571862d2ed` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:26.308035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b4c94-5af0-4510-a633-aafbd4fbf3d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=8855a1173a1b45fb8e20b8571862d2ed)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:26.358349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f81b4c94-5af0-4510-a633-aafbd4fbf3d1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 22:01:26.358691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b4c94-5af0-4510-a633-aafbd4fbf3d1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:26.363328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jul 28 22:01:26 2022] GET /identity/v3/projects/8855a1173a1b45fb8e20b8571862d2ed => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:28.330201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7760b2-5450-47e2-93fb-5724e023d737 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:28.330761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7760b2-5450-47e2-93fb-5724e023d737 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:28.330761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7760b2-5450-47e2-93fb-5724e023d737 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:28.335886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:28.341247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbffa-21d4-4ff7-add6-e55da6427f69 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:28.341670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbffa-21d4-4ff7-add6-e55da6427f69 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:28.341792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbffa-21d4-4ff7-add6-e55da6427f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:28.362116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-20edbffa-21d4-4ff7-add6-e55da6427f69 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:28.363669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-20edbffa-21d4-4ff7-add6-e55da6427f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:28.371462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 22:01:28.392979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7760b2-5450-47e2-93fb-5724e023d737 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:28.405422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7760b2-5450-47e2-93fb-5724e023d737 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:28.409642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43decd9e-aa39-407a-a8c3-a9a71b78c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:28.410256 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43decd9e-aa39-407a-a8c3-a9a71b78c028 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:28.410552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43decd9e-aa39-407a-a8c3-a9a71b78c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:28.410821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43decd9e-aa39-407a-a8c3-a9a71b78c028 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:28.419090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43decd9e-aa39-407a-a8c3-a9a71b78c028 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:28.420853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43decd9e-aa39-407a-a8c3-a9a71b78c028 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:28.429426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jul 28 22:01:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:01:28.434621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbffa-21d4-4ff7-add6-e55da6427f69 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:28.443377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbffa-21d4-4ff7-add6-e55da6427f69 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:28.448298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83542a-c513-45f3-a89c-652089bb28de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:28.448924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83542a-c513-45f3-a89c-652089bb28de admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:28.449275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83542a-c513-45f3-a89c-652089bb28de admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:28.449479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83542a-c513-45f3-a89c-652089bb28de admin admin] PATH_INFO: `/v3/users/f4a6891388094a448767f8355119febd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:28.450884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83542a-c513-45f3-a89c-652089bb28de admin admin] RBAC: Authorizing `identity:get_user(user_id=f4a6891388094a448767f8355119febd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:28.452687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83542a-c513-45f3-a89c-652089bb28de admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:28.454217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jul 28 22:01:28 2022] GET /identity/v3/users/f4a6891388094a448767f8355119febd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:30.481618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf77c3-e362-4509-a59f-267eae39fb8d None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:30.482137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf77c3-e362-4509-a59f-267eae39fb8d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:30.482137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf77c3-e362-4509-a59f-267eae39fb8d None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:30.483693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:30.488577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248fc19-4436-4f9c-a1ca-af889a7eaa62 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:30.488947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248fc19-4436-4f9c-a1ca-af889a7eaa62 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:30.489138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248fc19-4436-4f9c-a1ca-af889a7eaa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:30.508279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8248fc19-4436-4f9c-a1ca-af889a7eaa62 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:30.509481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8248fc19-4436-4f9c-a1ca-af889a7eaa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:30.542690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77416-2899-43f0-8e6e-d8578d081beb None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:30.542975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77416-2899-43f0-8e6e-d8578d081beb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:30.543252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77416-2899-43f0-8e6e-d8578d081beb None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:30.544571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:01:30.549600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:30.549887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:30.550166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:30.590732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:30.591168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG passlib.handlers.bcrypt [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80487) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 22:01:30.591619 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG passlib.handlers.bcrypt [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80487) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 22:01:30.613551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248fc19-4436-4f9c-a1ca-af889a7eaa62 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:30.636182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:30.637620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:30.639263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:30.717601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248fc19-4436-4f9c-a1ca-af889a7eaa62 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:30.738916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:01:30.750161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:30.750834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:30.751120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:30.751396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:30.760939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:30.763567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:30.772960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:30.773889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:01:30.774763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:01:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:01:30.779839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:30.858548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:30.860374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2846c31-d8f4-492b-b99f-bd8c117b52e5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:30.862750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:30.879226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02a0c7-0239-49c5-8891-5b0aa881720c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:30.899684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:30.900568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:30.900849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:30.901124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:30.913622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:30.914257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:30.914547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:30.914824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:30.915544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:30.915855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:30.917244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:30.929096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:30.934713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:30.967650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:30.969180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:31.033243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b948f-3649-4573-b88a-9210d309b23b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:31.067378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 22:01:31.073959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:31.077204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:31.171839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:31.172476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:31.172757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:31.173030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] PATH_INFO: `/v3/users/f4a6891388094a448767f8355119febd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:31.174248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a6891388094a448767f8355119febd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:31.175041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a0428-2314-4b87-a512-e31f41ea1864 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:31.175686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:31.177434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:30 2022] GET /identity/v3/users/f4a6891388094a448767f8355119febd => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:31.183339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:31.198295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:31.211732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:31.212586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:31.212863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:31.213132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:31.231974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:31.233447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:01:31.251634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:31.252649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:31.253468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:01:31.253468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:01:31.253468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:01:31.253468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:31.253468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:01:31.259533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:31.281592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d85b9-ebb2-4abd-82b6-f982cc9a8d31 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:31.314284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:31.314812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:31.315538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:31.315939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:31.316395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:31.317582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:31.319688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:31.321260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:31.326920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:31.357489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27badf-a357-4e58-bb58-5bb2d7e70eed None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:31.390928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e701d-b91b-46a0-a53a-0647b90e62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:31.391540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e701d-b91b-46a0-a53a-0647b90e62e7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:31.391819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e701d-b91b-46a0-a53a-0647b90e62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:31.392091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e701d-b91b-46a0-a53a-0647b90e62e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:31.392787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e701d-b91b-46a0-a53a-0647b90e62e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:31.393089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e701d-b91b-46a0-a53a-0647b90e62e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:31.394498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e701d-b91b-46a0-a53a-0647b90e62e7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:31.406515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:31.411411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:31.427168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de956007-7bcf-4aad-b945-f084a96c0d25 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:31.464633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4916468-ece9-4e16-865b-7d86dcf3bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:31.465282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4916468-ece9-4e16-865b-7d86dcf3bca8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:31.465566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4916468-ece9-4e16-865b-7d86dcf3bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:31.465839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4916468-ece9-4e16-865b-7d86dcf3bca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:31.466686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4916468-ece9-4e16-865b-7d86dcf3bca8 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.domain.id=default, user.id=f4a6891388094a448767f8355119febd) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:31.467002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4916468-ece9-4e16-865b-7d86dcf3bca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:31.468486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4916468-ece9-4e16-865b-7d86dcf3bca8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:31.476550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jul 28 22:01:31 2022] GET /identity/v3/role_assignments?user.id=f4a6891388094a448767f8355119febd&scope.domain.id=default&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:34.141733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe568-911f-433f-8b55-e71177faa2c8 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.142683 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe568-911f-433f-8b55-e71177faa2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.143191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe568-911f-433f-8b55-e71177faa2c8 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.144736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:34.150694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1428a0-10fd-4890-9d34-b7ff398d52a3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.151526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1428a0-10fd-4890-9d34-b7ff398d52a3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.152002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1428a0-10fd-4890-9d34-b7ff398d52a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.178464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bf1428a0-10fd-4890-9d34-b7ff398d52a3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:34.179992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bf1428a0-10fd-4890-9d34-b7ff398d52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:34.199007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1e17-27a4-401a-8f6b-939946803dcb None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.199607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1e17-27a4-401a-8f6b-939946803dcb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.200120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1e17-27a4-401a-8f6b-939946803dcb None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.201684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 12/23] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:01:34.207796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86932598-1a4d-47f9-8d73-0facb2935273 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.208387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86932598-1a4d-47f9-8d73-0facb2935273 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.208864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86932598-1a4d-47f9-8d73-0facb2935273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.236560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-86932598-1a4d-47f9-8d73-0facb2935273 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:34.239629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-86932598-1a4d-47f9-8d73-0facb2935273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:34.324529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 12/24] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:34.326119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1df25e-786c-4b9f-a8c8-b07e6eac4732 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.326631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1df25e-786c-4b9f-a8c8-b07e6eac4732 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.327123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1df25e-786c-4b9f-a8c8-b07e6eac4732 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.337256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 13/25] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:34.340209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221cc7-7e80-4255-a1f6-39e8f39a981c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.340724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221cc7-7e80-4255-a1f6-39e8f39a981c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.346661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221cc7-7e80-4255-a1f6-39e8f39a981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.370379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:01:34.372014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867ba45-2e38-49a8-80ae-b596215657d2 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.372361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867ba45-2e38-49a8-80ae-b596215657d2 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.372822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867ba45-2e38-49a8-80ae-b596215657d2 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.374663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:34.375666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867ba45-2e38-49a8-80ae-b596215657d2 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:34.381746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-58221cc7-7e80-4255-a1f6-39e8f39a981c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:34.383188 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-58221cc7-7e80-4255-a1f6-39e8f39a981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:34.442635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:34.481273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 14/28] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:34.491364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42551b5-975d-4901-a95f-2fcea5e75ce8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.491883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42551b5-975d-4901-a95f-2fcea5e75ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.492427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42551b5-975d-4901-a95f-2fcea5e75ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.502357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:34.504382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867ba45-2e38-49a8-80ae-b596215657d2 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:34.523781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e42551b5-975d-4901-a95f-2fcea5e75ce8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:34.525321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e42551b5-975d-4901-a95f-2fcea5e75ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:34.542521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:34.543264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.543622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.543970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.544770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:34.546441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:34.611469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:34.612543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42551b5-975d-4901-a95f-2fcea5e75ce8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:34.729272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42551b5-975d-4901-a95f-2fcea5e75ce8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:34.770654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:34.771506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:34.771947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:34.772964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:34.773896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:34.775574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:34.779606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:34.806433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 15/30] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 28 22:01:34 2022] POST /identity/v3/roles => generated 225 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:34.807687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:34.906414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 16/31] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 28 22:01:34 2022] POST /identity/v3/roles => generated 219 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:34.907530 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:34.962405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abfc81-9724-4c04-8c84-2e505f4aa37a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:34.975617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:35.009549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bf7e-5015-4d7e-8d84-e4f45dd77e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.010154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf7e-5015-4d7e-8d84-e4f45dd77e80 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.010468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf7e-5015-4d7e-8d84-e4f45dd77e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.010760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf7e-5015-4d7e-8d84-e4f45dd77e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.023544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bf7e-5015-4d7e-8d84-e4f45dd77e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.025291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bf7e-5015-4d7e-8d84-e4f45dd77e80 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-2d43bf7e-5015-4d7e-8d84-e4f45dd77e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:01:35.045801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:35.046803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:35.047607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:01:35.047607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:01:35.047607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:01:35.047607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:35.047607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 16/32] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:35.048472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe89d-26c9-4ff5-93b4-aeb6cdfa2599 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.048762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe89d-26c9-4ff5-93b4-aeb6cdfa2599 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.049035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe89d-26c9-4ff5-93b4-aeb6cdfa2599 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.056574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 17/33] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:35.057951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe89d-26c9-4ff5-93b4-aeb6cdfa2599 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.081647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074af59b-af2b-46c4-a3c0-aeb9f3879925 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.120211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf7c46-5926-4dfe-8749-d9b2d27fca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.120873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf7c46-5926-4dfe-8749-d9b2d27fca16 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.121157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf7c46-5926-4dfe-8749-d9b2d27fca16 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.121430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf7c46-5926-4dfe-8749-d9b2d27fca16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.133613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf7c46-5926-4dfe-8749-d9b2d27fca16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b8cf7c46-5926-4dfe-8749-d9b2d27fca16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:35.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:35.139553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:01:35.140301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 17/34] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:35.141951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dcc6c-0770-47c4-927d-b9434a321d65 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.141951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dcc6c-0770-47c4-927d-b9434a321d65 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.142317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dcc6c-0770-47c4-927d-b9434a321d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.162178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5a0dcc6c-0770-47c4-927d-b9434a321d65 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:35.164301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5a0dcc6c-0770-47c4-927d-b9434a321d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:35.190665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe89d-26c9-4ff5-93b4-aeb6cdfa2599 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.217236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:35.225003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bfe64-07e5-439e-8b3f-147a75ccef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.226157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bfe64-07e5-439e-8b3f-147a75ccef1c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.226470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bfe64-07e5-439e-8b3f-147a75ccef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.226753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bfe64-07e5-439e-8b3f-147a75ccef1c None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.227448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bfe64-07e5-439e-8b3f-147a75ccef1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:35.227755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bfe64-07e5-439e-8b3f-147a75ccef1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.229158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bfe64-07e5-439e-8b3f-147a75ccef1c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.235845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 18/35] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:35.237107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b492c-bbb6-4c1c-bba1-d016d64e554e None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.237398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b492c-bbb6-4c1c-bba1-d016d64e554e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.237677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b492c-bbb6-4c1c-bba1-d016d64e554e None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.238959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:35.239654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b492c-bbb6-4c1c-bba1-d016d64e554e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.242732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 18/37] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:35.244874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeb5b5-58e6-4d2e-a007-5127b27ef965 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.245370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeb5b5-58e6-4d2e-a007-5127b27ef965 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.245889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeb5b5-58e6-4d2e-a007-5127b27ef965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.266332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-26eeb5b5-58e6-4d2e-a007-5127b27ef965 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:35.267753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-26eeb5b5-58e6-4d2e-a007-5127b27ef965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:35.281145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:35.337085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 19/38] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:35.337807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeb5b5-58e6-4d2e-a007-5127b27ef965 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.353172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b492c-bbb6-4c1c-bba1-d016d64e554e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.387191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.387804 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.388090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.388378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.389098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:35.389406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.390954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.400215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 20/39] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:35.400787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.439192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeb5b5-58e6-4d2e-a007-5127b27ef965 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.449834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:35.477529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.478187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.478511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.478789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.479709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.481178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.502763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c94b5-5198-48dd-86e5-6dbb7d927d5f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.504481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:35.513869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:01:35 2022] POST /identity/v3/projects => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:35.515175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.541371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.541931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.542266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.542518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.543291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.544676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.561584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 28 22:01:35 2022] POST /identity/v3/roles => generated 223 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:35.562371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.652550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ec9c4-8340-4acf-930c-2ccc1bcf58b2 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.688954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155a62-79a6-44e4-8ec9-38a4eaee2b95 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.695834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.696631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.696920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.697199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.698511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.699046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:35.700003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.701726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 21/42] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:35.708046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.735271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.735271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.735271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.735740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] PATH_INFO: `/v3/users/f4a6891388094a448767f8355119febd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.737138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a6891388094a448767f8355119febd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.738479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.740292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:35 2022] GET /identity/v3/users/f4a6891388094a448767f8355119febd => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:35.749774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.802098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:35.836116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aa10e-aa4f-4c00-8f6e-8199114d9fe9 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.854609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d31c-f762-4482-8703-b2446c1f5d59 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:35.869626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152ddec-f0d9-469e-873d-1410d599cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.870267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ddec-f0d9-469e-873d-1410d599cb24 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.870553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ddec-f0d9-469e-873d-1410d599cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.870826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ddec-f0d9-469e-873d-1410d599cb24 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.871499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152ddec-f0d9-469e-873d-1410d599cb24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.872933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152ddec-f0d9-469e-873d-1410d599cb24 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.887674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:35.888314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:35.888600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:35.888888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:35.890151 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:35.891613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:35.893425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 23/44] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:35.898975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:35.899727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:01:35 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:35.945097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:36.006006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb5636-6b69-4801-b7ad-a57b57dcd0d4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:36.040937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299ec89-f439-4f80-aa5b-796da00028cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:36.041623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ec89-f439-4f80-aa5b-796da00028cb None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:36.041910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ec89-f439-4f80-aa5b-796da00028cb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:36.042192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ec89-f439-4f80-aa5b-796da00028cb None admin] PATH_INFO: `/v3/domains/default/users/f4a6891388094a448767f8355119febd/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:36.044257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299ec89-f439-4f80-aa5b-796da00028cb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f4a6891388094a448767f8355119febd, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:36.045718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299ec89-f439-4f80-aa5b-796da00028cb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:36.063222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 24/46] 10.222.0.48 () {58 vars in 1361 bytes} [Thu Jul 28 22:01:35 2022] PUT /identity/v3/domains/default/users/f4a6891388094a448767f8355119febd/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:01:37.911092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07323661-60de-46ab-9d24-021c2890eed8 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:37.912268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07323661-60de-46ab-9d24-021c2890eed8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:37.912268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07323661-60de-46ab-9d24-021c2890eed8 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:37.913955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:37.919349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e581114-6c0c-4ed1-bd5a-4fee3b79b616 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:37.919766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e581114-6c0c-4ed1-bd5a-4fee3b79b616 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:37.919911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e581114-6c0c-4ed1-bd5a-4fee3b79b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:37.938170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8e581114-6c0c-4ed1-bd5a-4fee3b79b616 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:37.939395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8e581114-6c0c-4ed1-bd5a-4fee3b79b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:38.004813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:38.016267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d657-2ca4-4c85-9cb0-21f95d10fdca None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.016557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d657-2ca4-4c85-9cb0-21f95d10fdca None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.016835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d657-2ca4-4c85-9cb0-21f95d10fdca None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.018178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 24/49] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:38.023209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596df66e-ea9b-4b30-a5b2-99570a724d62 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.023501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596df66e-ea9b-4b30-a5b2-99570a724d62 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.023781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596df66e-ea9b-4b30-a5b2-99570a724d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.027956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4d657-2ca4-4c85-9cb0-21f95d10fdca None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:38.041883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-596df66e-ea9b-4b30-a5b2-99570a724d62 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:38.043114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-596df66e-ea9b-4b30-a5b2-99570a724d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:38.068291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:38.110241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 26/50] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:38.132301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4d657-2ca4-4c85-9cb0-21f95d10fdca None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:38.133002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596df66e-ea9b-4b30-a5b2-99570a724d62 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:38.154194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:38.170607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:38.171198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.171477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.171748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.172901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:38.174395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:38.175971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:38.181963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:38.231271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596df66e-ea9b-4b30-a5b2-99570a724d62 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:38.264769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:38.265410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.265695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.265975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.276117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:38.280161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b9e84-e831-49d4-b7e8-19a8427442dd None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:38.281080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:38.281925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:01:38.282885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:01:38.288341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:38.313348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:38.317197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:38.317824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.318111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.318436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.319642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:38.321091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:38.347765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 26/53] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jul 28 22:01:38 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:01:38.400914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c86900-4a3e-45e1-8763-4aaa2383f81a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:38.436474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:38.437019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.437302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.437573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.438350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:38.438691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:38.440087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:38.449525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:38.455313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:38.498799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:38.558023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df332-9927-4e7f-8348-c79d279374f7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:38.591702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:38.592347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.592631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.592908 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] PATH_INFO: `/v3/users/f4a6891388094a448767f8355119febd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.594324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a6891388094a448767f8355119febd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:38.595777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:38.597536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:38 2022] GET /identity/v3/users/f4a6891388094a448767f8355119febd => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:38.602959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:38.684494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:38.700294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad81c-e1d0-4d97-a380-51b30aef4a4b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:38.732122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916ca48-bfc1-4fc2-ba92-fa1adafe4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:38.732756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ca48-bfc1-4fc2-ba92-fa1adafe4d8f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.733033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ca48-bfc1-4fc2-ba92-fa1adafe4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.733303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ca48-bfc1-4fc2-ba92-fa1adafe4d8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.734462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916ca48-bfc1-4fc2-ba92-fa1adafe4d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:38.735898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916ca48-bfc1-4fc2-ba92-fa1adafe4d8f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:38.737465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:38.743744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:38.842369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564a7d3-5b13-491d-9261-f871c73b56c9 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:38.850881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:38.875283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d913e-04ac-4330-bcda-3b59cdbd3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:38.875900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d913e-04ac-4330-bcda-3b59cdbd3f4d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:38.876192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d913e-04ac-4330-bcda-3b59cdbd3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:38.876463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d913e-04ac-4330-bcda-3b59cdbd3f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:38.877250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d913e-04ac-4330-bcda-3b59cdbd3f4d None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.domain.id=default, user.id=f4a6891388094a448767f8355119febd) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:38.877559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d913e-04ac-4330-bcda-3b59cdbd3f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:38.879284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d913e-04ac-4330-bcda-3b59cdbd3f4d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:38.888704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jul 28 22:01:38 2022] GET /identity/v3/role_assignments?user.id=f4a6891388094a448767f8355119febd&scope.domain.id=default&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:40.356045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed6334-e7eb-4667-b063-2a758b099c49 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:40.356550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed6334-e7eb-4667-b063-2a758b099c49 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:40.356656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed6334-e7eb-4667-b063-2a758b099c49 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:40.357935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:40.362903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2482f22-2e90-47aa-ae50-d49163081443 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:40.363290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2482f22-2e90-47aa-ae50-d49163081443 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:40.363465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2482f22-2e90-47aa-ae50-d49163081443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:40.382309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d2482f22-2e90-47aa-ae50-d49163081443 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:40.383510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d2482f22-2e90-47aa-ae50-d49163081443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:40.448308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:40.471465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed6334-e7eb-4667-b063-2a758b099c49 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:40.570408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed6334-e7eb-4667-b063-2a758b099c49 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:40.602477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4cc6b-6315-4dac-8f21-4da0e3481a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:40.603102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cc6b-6315-4dac-8f21-4da0e3481a10 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:40.603387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cc6b-6315-4dac-8f21-4da0e3481a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:40.603663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4cc6b-6315-4dac-8f21-4da0e3481a10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:40.604816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4cc6b-6315-4dac-8f21-4da0e3481a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:40.606273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4cc6b-6315-4dac-8f21-4da0e3481a10 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:40.607821 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:40.613245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2482f22-2e90-47aa-ae50-d49163081443 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:40.708467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2482f22-2e90-47aa-ae50-d49163081443 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:40.709917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:40.741911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1070d-5a5d-45e4-bc55-cb7eccf17af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:40.742545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1070d-5a5d-45e4-bc55-cb7eccf17af8 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:40.742826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1070d-5a5d-45e4-bc55-cb7eccf17af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:40.743099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1070d-5a5d-45e4-bc55-cb7eccf17af8 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:40.743773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1070d-5a5d-45e4-bc55-cb7eccf17af8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:40.745216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1070d-5a5d-45e4-bc55-cb7eccf17af8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:40.770753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:01:40 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:43.975410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716e717-39a0-45b5-aa37-1d8aefd2b07f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:43.976422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716e717-39a0-45b5-aa37-1d8aefd2b07f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:43.976781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49607d8-7dd8-448a-b358-eb23fbd395a1 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:43.977186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716e717-39a0-45b5-aa37-1d8aefd2b07f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:43.977689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49607d8-7dd8-448a-b358-eb23fbd395a1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:43.978165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49607d8-7dd8-448a-b358-eb23fbd395a1 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:43.978638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:43.980150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:01:43.983871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea840ba5-9b63-454d-8bea-9072a4a72742 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:43.984193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea840ba5-9b63-454d-8bea-9072a4a72742 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:43.984487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea840ba5-9b63-454d-8bea-9072a4a72742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:43.985822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c71132-a418-4516-af0f-b842af4d96c6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:43.986379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c71132-a418-4516-af0f-b842af4d96c6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:43.986961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c71132-a418-4516-af0f-b842af4d96c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.023620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ea840ba5-9b63-454d-8bea-9072a4a72742 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:44.025650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ea840ba5-9b63-454d-8bea-9072a4a72742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:44.026866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-36c71132-a418-4516-af0f-b842af4d96c6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:44.028310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-36c71132-a418-4516-af0f-b842af4d96c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:44.045296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:44.124475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 33/64] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:44.124810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:44.126261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e027d5-0b2c-45d9-bdad-30148c3c2ef6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.126567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e027d5-0b2c-45d9-bdad-30148c3c2ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.126845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e027d5-0b2c-45d9-bdad-30148c3c2ef6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.128185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 34/66] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:44.148030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fc3f6-d708-410b-8b84-c7350352dc26 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.148318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fc3f6-d708-410b-8b84-c7350352dc26 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.148592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fc3f6-d708-410b-8b84-c7350352dc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.149882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e027d5-0b2c-45d9-bdad-30148c3c2ef6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.179576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-273fc3f6-d708-410b-8b84-c7350352dc26 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:44.181211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-273fc3f6-d708-410b-8b84-c7350352dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:44.263091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 33/67] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:44.268477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e027d5-0b2c-45d9-bdad-30148c3c2ef6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.270611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fc3f6-d708-410b-8b84-c7350352dc26 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.303725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:44.305772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.306703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.307238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.307873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.321237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:44.326211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:44.327178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:01:44.327962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:01:44.328599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.346325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:44.404736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fc3f6-d708-410b-8b84-c7350352dc26 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.444744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baad94-9569-4dd2-87db-64bc2204a06b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.446956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.447618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.447901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.448177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.459985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:44.466569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:44.467596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:44.468512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.480867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714af41-be3e-42c6-b983-e23e1d528848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.481511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714af41-be3e-42c6-b983-e23e1d528848 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.481797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714af41-be3e-42c6-b983-e23e1d528848 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.482072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714af41-be3e-42c6-b983-e23e1d528848 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.492109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714af41-be3e-42c6-b983-e23e1d528848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1714af41-be3e-42c6-b983-e23e1d528848 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:44.497080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:44.497927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:01:44.499070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:44.499846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc2f66-8269-4ae3-ae48-a73477633b15 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.499846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc2f66-8269-4ae3-ae48-a73477633b15 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.499959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc2f66-8269-4ae3-ae48-a73477633b15 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.501136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 37/71] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:44.502186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3141083-f846-4d69-bc11-5d9788067a91 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.502561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3141083-f846-4d69-bc11-5d9788067a91 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.502805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3141083-f846-4d69-bc11-5d9788067a91 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.504213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 38/72] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:44.504909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3141083-f846-4d69-bc11-5d9788067a91 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.555383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:44.576550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5488a-2913-4d20-a8d0-8ddd31d68cca None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.577999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:44.608732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3141083-f846-4d69-bc11-5d9788067a91 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.609253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.609872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.610155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.610449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.611221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:44.611525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:44.612906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:44.624942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 35/73] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:44.625733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.643103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9318d4c-7c43-4a22-875f-3ac70402784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.643713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318d4c-7c43-4a22-875f-3ac70402784d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.643995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318d4c-7c43-4a22-875f-3ac70402784d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.644267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318d4c-7c43-4a22-875f-3ac70402784d None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.644976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9318d4c-7c43-4a22-875f-3ac70402784d None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:44.645282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9318d4c-7c43-4a22-875f-3ac70402784d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:44.646725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9318d4c-7c43-4a22-875f-3ac70402784d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:44.654701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 39/74] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:44.655853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c20a-ce91-4a85-9c7f-83044df1e631 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.656141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c20a-ce91-4a85-9c7f-83044df1e631 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.656422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c20a-ce91-4a85-9c7f-83044df1e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.673501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f5b2c20a-ce91-4a85-9c7f-83044df1e631 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:44.674725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f5b2c20a-ce91-4a85-9c7f-83044df1e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:44.724469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7091d-72ba-48d9-9afa-aa1b0dffbd39 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.738661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 40/75] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:44.739880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2719d-74d1-4612-a8df-e6da21a34e4b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.740174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2719d-74d1-4612-a8df-e6da21a34e4b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.740973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2719d-74d1-4612-a8df-e6da21a34e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.758487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4cf2719d-74d1-4612-a8df-e6da21a34e4b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:44.759362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.759678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4cf2719d-74d1-4612-a8df-e6da21a34e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:44.759986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.760268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.760542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.761256 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:44.761699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:44.763109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:44.775092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 36/76] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:44.775092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.775343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:44.823174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:44.833412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 41/77] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:44.834267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2719d-74d1-4612-a8df-e6da21a34e4b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.872821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215afb-b676-47be-9e61-73f1def1bcd3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.906862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.907506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.907792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.908069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] PATH_INFO: `/v3/users/f4a6891388094a448767f8355119febd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.909277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a6891388094a448767f8355119febd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:44.910785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:44.912966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 37/78] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/users/f4a6891388094a448767f8355119febd => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:44.917729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.932856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2719d-74d1-4612-a8df-e6da21a34e4b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:44.965170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:44.965812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:44.966091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:44.966406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:44.980214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:44.981665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:44.983335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 42/79] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:44.984095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:44.992699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.017510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04cd8-5ec3-466f-a59f-630674223cf8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.032957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.050564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.051207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.051494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.051768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.062332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:45.067643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:45.068773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:45.069710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 38/80] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:45.071032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.085349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf779b-d539-41e9-b5da-590d7971ea28 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.120759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.121403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.121689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.121967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.123175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.124612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.126217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 43/81] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:44 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:45.131111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.171756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d342e-8301-47c3-9c57-8833e1ea8611 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.199959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.206141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.206814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.207109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.207391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.208574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.210043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.211672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 39/82] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:45.212510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.229170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff927b-1c6c-4a1d-a41c-ca0db8691a64 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.246388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.265404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.266021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.266334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.266611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.314677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b482-691e-4b61-9d72-24c2b2f0d2bb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.333933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.336075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.347257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.347870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.348152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.348426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.413991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.418292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.419905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.434330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 44/83] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:45.435174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.452851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.519309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 40/84] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:45.520152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.533495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f84a-3564-41d5-9add-e93c62df0d40 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.570047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.570696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.570973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.571250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.571957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:45.572261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.573641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.581435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 45/85] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:45.582187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.613453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.617423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8210152-81cd-4e57-92b8-49ea1a446de6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.651227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.652541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.652853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.653131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.661876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.682456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b8b2b-14b5-441d-975b-3f16c38c7ebb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.717411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.718031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.718347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.718626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.719316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.720763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.721337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.722841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.746927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 46/86] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:01:45 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:45.747753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.830181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.838424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 41/87] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:45.839345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.864032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e13f3-22af-497f-a633-e6027cd9a169 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:45.901956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:45.902152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:45.902534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:45.902717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:45.905324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:45.906276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:45.907774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 47/88] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:45.908546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:45.912745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:45.958819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0daf-1c2e-47c6-8be1-a5859c8870c1 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:46.002731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:46.003411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:46.003942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:46.004222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:46.005865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:46.007776 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:46.009810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 42/89] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:46.010908 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:46.045377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878773f5-acf3-4b90-99bb-44840a2f97c8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:46.090538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:46.091537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:46.091884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:46.092224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:46.094062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:46.095984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:46.098436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 48/90] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:45 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:46.099127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:46.099795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:46.146192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41deffe9-d5a5-476e-82fe-19e89c7a39ff None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:46.190439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:46.191238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:46.191538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:46.192651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:46.193933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:46.195425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:46.197733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 43/91] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:46 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:46.198544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:46.206734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:46.234402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6d49e-3eba-4e9a-8c45-63f7dd78f49e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:46.277924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:46.278837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:46.279154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:46.279655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:46.281004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=f4a6891388094a448767f8355119febd) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:46.281454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:46.283046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:46.291330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 49/92] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:46 2022] GET /identity/v3/role_assignments?user.id=f4a6891388094a448767f8355119febd&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:46.303381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:46.354994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15e866-3a5d-40c5-b3db-128716dd064a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:46.426512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:46.427080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:46.427366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:46.427644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:46.428464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=75ab0515763a46178ee145ae4a916195) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:46.428824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:46.430472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:46.444897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:46.447698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 44/93] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:46 2022] GET /identity/v3/role_assignments?user.id=75ab0515763a46178ee145ae4a916195&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:46.448587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:46.487929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a6292-3950-45c9-9924-4f221f7c2a2b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:46.563085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:46.563817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:46.564104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:46.564377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:46.570466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1589cf6-e6d9-4953-92e8-ace039a68edf None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:46.572796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:46.619162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:46.619812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:46.621054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:46.621337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:46.622165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] RBAC: Adding query filter params (role.id=16d20d9321574453897849a9f649b636, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=75ab0515763a46178ee145ae4a916195) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:46.622510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:46.624014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:46.636665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 45/94] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:46 2022] GET /identity/v3/role_assignments?user.id=75ab0515763a46178ee145ae4a916195&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=16d20d9321574453897849a9f649b636 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:46.703746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:46.705267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:46.851539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 50/95] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:46.857138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:46.921933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:46.971513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83578c61-b53b-418b-80fb-dbfcbf733ed8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:47.007506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d947c-9ba7-4ae2-999d-44505af9319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:47.008278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d947c-9ba7-4ae2-999d-44505af9319a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:47.008455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d947c-9ba7-4ae2-999d-44505af9319a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:47.008710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d947c-9ba7-4ae2-999d-44505af9319a None admin] PATH_INFO: `/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:47.009960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d947c-9ba7-4ae2-999d-44505af9319a None admin] RBAC: Authorizing `identity:get_project(project_id=a2848e011eaf4104bbe3968ac0ee9b73)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:47.011461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d947c-9ba7-4ae2-999d-44505af9319a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:47.013302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 46/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:46 2022] GET /identity/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:47.019215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:47.066733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:47.155843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11bbe-9ae6-40e2-9353-77ead1ec972b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:47.203220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b5415-0477-4a7c-9b44-f384867d9c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:47.203855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b5415-0477-4a7c-9b44-f384867d9c9e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:47.204137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b5415-0477-4a7c-9b44-f384867d9c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:47.204409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b5415-0477-4a7c-9b44-f384867d9c9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:47.205201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b5415-0477-4a7c-9b44-f384867d9c9e None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=a2848e011eaf4104bbe3968ac0ee9b73, user.id=75ab0515763a46178ee145ae4a916195) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:47.205509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b5415-0477-4a7c-9b44-f384867d9c9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:47.206980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b5415-0477-4a7c-9b44-f384867d9c9e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:47.212649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 51/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:47 2022] GET /identity/v3/role_assignments?user.id=75ab0515763a46178ee145ae4a916195&scope.project.id=a2848e011eaf4104bbe3968ac0ee9b73&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:48.273804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6b66-c2c3-497e-bcd3-24ccc459f9e9 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:48.274814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6b66-c2c3-497e-bcd3-24ccc459f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:48.275318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6b66-c2c3-497e-bcd3-24ccc459f9e9 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:48.277149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 47/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:48.281924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5171a-1a2a-4923-b088-7c503e714b04 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:48.282729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5171a-1a2a-4923-b088-7c503e714b04 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:48.283231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5171a-1a2a-4923-b088-7c503e714b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:48.311277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-45a5171a-1a2a-4923-b088-7c503e714b04 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:48.312801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-45a5171a-1a2a-4923-b088-7c503e714b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:48.389776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 52/99] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:48.423991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c6b66-c2c3-497e-bcd3-24ccc459f9e9 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:48.544151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c6b66-c2c3-497e-bcd3-24ccc459f9e9 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:48.574500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:48.579942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ce50a-fe00-4685-89c4-901d64eb75a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:48.580831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ce50a-fe00-4685-89c4-901d64eb75a4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:48.581312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ce50a-fe00-4685-89c4-901d64eb75a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:48.581809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ce50a-fe00-4685-89c4-901d64eb75a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:48.593982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ce50a-fe00-4685-89c4-901d64eb75a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-781ce50a-fe00-4685-89c4-901d64eb75a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:48.600241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:48.601108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:01:48.601860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:48.604220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 48/100] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:01:48.614551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5171a-1a2a-4923-b088-7c503e714b04 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:48.653621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:48.737849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b49eb-f252-45ff-a0c3-ec8d4d08985e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:48.738515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b49eb-f252-45ff-a0c3-ec8d4d08985e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:48.739096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b49eb-f252-45ff-a0c3-ec8d4d08985e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:48.740737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 49/101] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:48.743771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5171a-1a2a-4923-b088-7c503e714b04 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:48.746209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71272-f984-4445-9a4e-d76f0f3d879d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:48.746732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71272-f984-4445-9a4e-d76f0f3d879d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:48.747203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d71272-f984-4445-9a4e-d76f0f3d879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:48.769571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-74d71272-f984-4445-9a4e-d76f0f3d879d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:48.772984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-74d71272-f984-4445-9a4e-d76f0f3d879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:48.814182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:48.814875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:48.815227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:48.815507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:48.816282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:48.816594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:48.818068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:48.837918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 53/102] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:48.843546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:48.910928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 50/103] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:48.938624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71272-f984-4445-9a4e-d76f0f3d879d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:49.018616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:49.029764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d6e0d-1dd2-4202-a39c-8659a4fa5ba0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:49.088070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:49.089126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.089628 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.090101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] PATH_INFO: `/v3/users/b6fcc836589e441c85caba269357e4ce` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.091213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d71272-f984-4445-9a4e-d76f0f3d879d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:49.111762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:49.115064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] RBAC: Authorizing `identity:get_user(user_id=b6fcc836589e441c85caba269357e4ce)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:49.117455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:49.119544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 54/104] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:48 2022] GET /identity/v3/users/b6fcc836589e441c85caba269357e4ce => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:49.126551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:49.131916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:49.132158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.132450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.132719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.139409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:49.140531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:49.142199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 51/105] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:49.163938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:49.239596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f53d-a79d-4eb9-889e-45c8153375fe None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:49.277220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:49.278295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.279003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.279505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.302642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:49.303770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d860da-4af0-40ab-814e-a5be4f084985 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:49.338594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5331a-4167-4c3e-bfcc-b5e245f7e843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:49.339113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5331a-4167-4c3e-bfcc-b5e245f7e843 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.339392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5331a-4167-4c3e-bfcc-b5e245f7e843 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.339668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5331a-4167-4c3e-bfcc-b5e245f7e843 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.340355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5331a-4167-4c3e-bfcc-b5e245f7e843 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:49.341793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5331a-4167-4c3e-bfcc-b5e245f7e843 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:49.354352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:49.356028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:49.374427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 52/106] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:01:49 2022] POST /identity/v3/projects => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:49.375870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66da4e-75ba-4583-9447-ac5bf24fc21b None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.376166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66da4e-75ba-4583-9447-ac5bf24fc21b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.376445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66da4e-75ba-4583-9447-ac5bf24fc21b None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.377996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 53/107] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:49.384495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd092-b8d7-4c90-b9e4-a5547e9b6ae6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.384842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd092-b8d7-4c90-b9e4-a5547e9b6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.385175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd092-b8d7-4c90-b9e4-a5547e9b6ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.423631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c8dcd092-b8d7-4c90-b9e4-a5547e9b6ae6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:49.426983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c8dcd092-b8d7-4c90-b9e4-a5547e9b6ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:49.505748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:49.568960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 55/108] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:49.573636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 54/109] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:01:49.579317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:49.647501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:49.671717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd092-b8d7-4c90-b9e4-a5547e9b6ae6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:49.708668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74806232-3b92-47a0-a378-8e01ffea0aa6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:49.748837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:49.749490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.749774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.750050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.751547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:49.753497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:49.756080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 56/110] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:49 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:49.762683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:49.875361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ece03-5c33-4db0-8a4f-ed82fd6d65c3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:49.877416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd092-b8d7-4c90-b9e4-a5547e9b6ae6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:49.914297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:49.917165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3beb5-23ba-44b1-9ead-4f63d77e9bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:49.918075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3beb5-23ba-44b1-9ead-4f63d77e9bdd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.918548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3beb5-23ba-44b1-9ead-4f63d77e9bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.919004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3beb5-23ba-44b1-9ead-4f63d77e9bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.930775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3beb5-23ba-44b1-9ead-4f63d77e9bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-26d3beb5-23ba-44b1-9ead-4f63d77e9bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:49.936036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:49.936870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:49.937638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:49.940377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 55/111] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:01:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:49.940898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:49.941582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.941868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.942146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.942557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644f50-4cf4-45e6-bc3f-5e77f46dc93d None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.943019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644f50-4cf4-45e6-bc3f-5e77f46dc93d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.943117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] RBAC: Adding query filter params (role.id=dfdbf88fc1e14740ba5405837f6bf2fc, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=b6fcc836589e441c85caba269357e4ce) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:49.943393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:49.944322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644f50-4cf4-45e6-bc3f-5e77f46dc93d None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.945346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:49.945963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 56/112] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:49.952212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a5b0-eb08-4f3d-a5c3-d54a8148f7be None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:49.952641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 57/113] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:49 2022] GET /identity/v3/role_assignments?user.id=b6fcc836589e441c85caba269357e4ce&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=dfdbf88fc1e14740ba5405837f6bf2fc => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:49.952977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a5b0-eb08-4f3d-a5c3-d54a8148f7be None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:49.953434 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a5b0-eb08-4f3d-a5c3-d54a8148f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:49.964099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:49.987340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-1ca7a5b0-eb08-4f3d-a5c3-d54a8148f7be None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:49.988868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1ca7a5b0-eb08-4f3d-a5c3-d54a8148f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:50.030748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:50.116655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 57/114] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:50.148458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb053-b034-4f11-9acd-0cba1643db19 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.154857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb053-b034-4f11-9acd-0cba1643db19 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.155541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb053-b034-4f11-9acd-0cba1643db19 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.157521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 58/115] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:50.158566 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb053-b034-4f11-9acd-0cba1643db19 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.167922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36667a48-862c-46a7-9655-c624f44ddf45 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.204363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df2ae-a3fa-463d-b5c0-a451b3b287c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:50.205261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df2ae-a3fa-463d-b5c0-a451b3b287c1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.205751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df2ae-a3fa-463d-b5c0-a451b3b287c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.206029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df2ae-a3fa-463d-b5c0-a451b3b287c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.206858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df2ae-a3fa-463d-b5c0-a451b3b287c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:50.207236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df2ae-a3fa-463d-b5c0-a451b3b287c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:50.209168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df2ae-a3fa-463d-b5c0-a451b3b287c1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:50.219783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 58/116] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:50.221293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8518b-415c-4ed7-955c-0882ca7bf0ec None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.221578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8518b-415c-4ed7-955c-0882ca7bf0ec None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.221850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8518b-415c-4ed7-955c-0882ca7bf0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.244576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e1f8518b-415c-4ed7-955c-0882ca7bf0ec None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:50.245859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e1f8518b-415c-4ed7-955c-0882ca7bf0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:50.294579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:50.305617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb053-b034-4f11-9acd-0cba1643db19 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.330417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 59/117] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:50.331813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1212-6b33-4a49-b946-7976ecdc007e None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.332101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1212-6b33-4a49-b946-7976ecdc007e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.332372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1212-6b33-4a49-b946-7976ecdc007e None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.333676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 60/118] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:50.334503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1212-6b33-4a49-b946-7976ecdc007e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.363995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846c9d-6fe5-49d9-ac92-a6da866fb37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:50.364772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846c9d-6fe5-49d9-ac92-a6da866fb37f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.365059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846c9d-6fe5-49d9-ac92-a6da866fb37f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.366004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846c9d-6fe5-49d9-ac92-a6da866fb37f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.377875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846c9d-6fe5-49d9-ac92-a6da866fb37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-75846c9d-6fe5-49d9-ac92-a6da866fb37f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:50.384739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:50.385711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:50.386913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 59/119] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:50.387545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0095ac-f91a-47be-addd-dd35c75b53a6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.387817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0095ac-f91a-47be-addd-dd35c75b53a6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.388060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0095ac-f91a-47be-addd-dd35c75b53a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.407118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ef0095ac-f91a-47be-addd-dd35c75b53a6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:50.408823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ef0095ac-f91a-47be-addd-dd35c75b53a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:50.442636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:50.475826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1212-6b33-4a49-b946-7976ecdc007e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.487682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 60/120] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:50.489049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0095ac-f91a-47be-addd-dd35c75b53a6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.516573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:50.517458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.517885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.518331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] PATH_INFO: `/v3/users/f4a6891388094a448767f8355119febd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.519674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a6891388094a448767f8355119febd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:50.521967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:50.524323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 61/121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/users/f4a6891388094a448767f8355119febd => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:50.525536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.580392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:50.621364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0095ac-f91a-47be-addd-dd35c75b53a6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.656313 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf15083-766b-43ae-a126-531ec792e509 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.661115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:50.661986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.663046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.663506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.674705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:50.680294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:50.681126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:50.681903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:50.684491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 61/122] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:50.685654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.694505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:50.695130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.695419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.695696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.696417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:50.696726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:50.698612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:50.701551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:50.709885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 62/123] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:50.710927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.821052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552144-d7ea-4c54-a85f-116a27228c97 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.827768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057a57e-de1c-4933-b808-6f047326c581 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.831247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:50.867643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:50.868819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.869384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.869911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.871671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:50.872289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:50.873033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:50.873314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:50.873584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:50.874380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:50.876226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 63/124] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:50.877187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.886562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:50.893059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:50.893911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:50.894720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 62/125] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:50.895356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:50.984684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde316-d3c5-40b5-98d2-a2e0a5e167b9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:50.986452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:51.022575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.023498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.023746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9de99-f0a6-45b9-b34e-125ace163f54 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.024069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.024480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.025324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:51.025822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.027442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.036239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 64/126] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:51.037309 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.060747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.061426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.061718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.062005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.063340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.064836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.066761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 63/127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:50 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:51.067419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.077457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:51.166349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26049-59ab-4361-8f07-d45cc0281efb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.187739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dfae9-d344-4487-898a-5445fb00dd50 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.219094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.220109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.220914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.221210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/f4a6891388094a448767f8355119febd/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.224470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c43f8201b34f6a8c1765c89e41545c, user_id=f4a6891388094a448767f8355119febd, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.226394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.229085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.229797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.230088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.230404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.231136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:51.231451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.233065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.239795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:51.244536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 64/128] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:51.245185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 65/129] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:01:51 2022] PUT /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/f4a6891388094a448767f8355119febd/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:01:51.245888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.246433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.357948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:51.360294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce367b5-fb76-4081-b487-e05d3ed07432 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.365924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02f086-2827-411e-a303-436b1459e75f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.399871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.400590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.400880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.401162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.402388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.403873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.405625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 65/130] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:51 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:51.405743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.406407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.406529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.406966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] PATH_INFO: `/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.411049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] RBAC: Authorizing `identity:get_project(project_id=a2848e011eaf4104bbe3968ac0ee9b73)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.412657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.414512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 66/131] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:51 2022] GET /identity/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:51.415324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.507906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:51.528964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301509a-96d2-4567-8972-b5914a6ac79c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.552044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63492e-478b-45d8-adc8-8d4292ddadbe None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.574979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.575675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.576174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.576452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.578026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.579509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.582035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 67/132] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:51 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:51.583183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.605232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.605895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.606376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.606659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.608662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.610551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.612181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 66/133] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:51 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:51.612996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.642617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:51.731517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859dbd4-d2e2-43b3-8fb6-b1752dc77e90 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.734043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6a1f-354b-448a-ace1-fdc0af13a6a8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:51.771169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.771988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.772319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.772865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/75ab0515763a46178ee145ae4a916195/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.775118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c43f8201b34f6a8c1765c89e41545c, user_id=75ab0515763a46178ee145ae4a916195, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.776727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.781099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:51.800738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59bb5-5899-41e2-98c2-48772630cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:51.804111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 67/134] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:01:51 2022] PUT /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/75ab0515763a46178ee145ae4a916195/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:01:51.804503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59bb5-5899-41e2-98c2-48772630cd0c None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:51.804806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59bb5-5899-41e2-98c2-48772630cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:51.805094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59bb5-5899-41e2-98c2-48772630cd0c None admin] PATH_INFO: `/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73/users/75ab0515763a46178ee145ae4a916195/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:51.805744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:51.815340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf59bb5-5899-41e2-98c2-48772630cd0c None admin] RBAC: Authorizing `identity:create_grant(project_id=a2848e011eaf4104bbe3968ac0ee9b73, user_id=75ab0515763a46178ee145ae4a916195, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:51.816834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf59bb5-5899-41e2-98c2-48772630cd0c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:51.888563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 68/135] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:01:51 2022] PUT /identity/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73/users/75ab0515763a46178ee145ae4a916195/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:01:52.017709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db3a4d-1d33-424c-b330-4d34d34a4c63 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:52.058046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:52.059051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.059482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.059905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.061416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:52.063185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:52.065478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 68/136] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:51 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:52.069379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc22bc-2d3b-4522-a256-284af90e88ff None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.069379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc22bc-2d3b-4522-a256-284af90e88ff None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.069379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc22bc-2d3b-4522-a256-284af90e88ff None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.069379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 69/137] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:52.075154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:52.080284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6ccb-153d-41cc-8b9f-14d16c7e72a8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.080284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6ccb-153d-41cc-8b9f-14d16c7e72a8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.080284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6ccb-153d-41cc-8b9f-14d16c7e72a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.100529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d43b6ccb-153d-41cc-8b9f-14d16c7e72a8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:52.101794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d43b6ccb-153d-41cc-8b9f-14d16c7e72a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:52.166000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:52.175879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:01:52.200421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b6ccb-153d-41cc-8b9f-14d16c7e72a8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:52.214914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ae8e4-6084-44e1-9aa7-00416d655200 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:52.231148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:52.255241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:52.256403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.256885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.257348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/75ab0515763a46178ee145ae4a916195/roles/16d20d9321574453897849a9f649b636` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.260609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c43f8201b34f6a8c1765c89e41545c, user_id=75ab0515763a46178ee145ae4a916195, role_id=16d20d9321574453897849a9f649b636)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:52.262306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:52.280186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:01:52 2022] PUT /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/75ab0515763a46178ee145ae4a916195/roles/16d20d9321574453897849a9f649b636 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:01:52.324583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b6ccb-153d-41cc-8b9f-14d16c7e72a8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:52.364899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33b13b-27c9-45ac-a695-d38b0811c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:52.366417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b13b-27c9-45ac-a695-d38b0811c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.366894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b13b-27c9-45ac-a695-d38b0811c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.367358 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33b13b-27c9-45ac-a695-d38b0811c3a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.368840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33b13b-27c9-45ac-a695-d38b0811c3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:52.370557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33b13b-27c9-45ac-a695-d38b0811c3a0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:52.372465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 71/140] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:52.378250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:52.467891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ffd8-305a-408d-ac15-36537981e01f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.468079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ffd8-305a-408d-ac15-36537981e01f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.468334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ffd8-305a-408d-ac15-36537981e01f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.469871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 72/141] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:01:52.475485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee8b9-8d8e-4985-bf42-ddb990264eef None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.475764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee8b9-8d8e-4985-bf42-ddb990264eef None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee8b9-8d8e-4985-bf42-ddb990264eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.499930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-139ee8b9-8d8e-4985-bf42-ddb990264eef None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:52.501357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-139ee8b9-8d8e-4985-bf42-ddb990264eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:52.513499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8228f-92fc-4082-96b1-54ab0a7a86b4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:52.546805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:52.560480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:52.561510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.561996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.562562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.564050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:52.565741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:52.590472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 73/142] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:01:52.602347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 70/143] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:01:52 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:01:52.618563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee8b9-8d8e-4985-bf42-ddb990264eef None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:52.661073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:52.783796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee8b9-8d8e-4985-bf42-ddb990264eef None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:52.841284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:52.841932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:52.842210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:52.842504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:52.856611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:52.861591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:52.862499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:01:52.863293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 74/144] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:52.869749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:53.002620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949142a-948a-4141-9836-70eddb77d2a3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:53.043285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:53.044257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:53.044742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:53.045231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:53.046152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:53.046772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:53.048389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:53.058302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 71/145] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:53.066361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:53.173787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:53.202260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ca54-23ed-46f6-bb88-e9605739ab0e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:53.251864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:53.252516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:53.252796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:53.253068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] PATH_INFO: `/v3/users/b6fcc836589e441c85caba269357e4ce` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:53.254552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] RBAC: Authorizing `identity:get_user(user_id=b6fcc836589e441c85caba269357e4ce)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:53.256085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:53.257653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 75/146] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:53 2022] GET /identity/v3/users/b6fcc836589e441c85caba269357e4ce => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:53.263261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:53.327967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:53.402165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dd4d6-f9ee-4307-adb0-8a24df00f5b3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:53.441128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06053c7a-ed86-4dbc-bc24-aa9a5ea27027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:53.441784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06053c7a-ed86-4dbc-bc24-aa9a5ea27027 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:53.442069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06053c7a-ed86-4dbc-bc24-aa9a5ea27027 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:53.442421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06053c7a-ed86-4dbc-bc24-aa9a5ea27027 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:53.443670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06053c7a-ed86-4dbc-bc24-aa9a5ea27027 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:53.445175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06053c7a-ed86-4dbc-bc24-aa9a5ea27027 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:53.446887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 72/147] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:53 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:53.452710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:53.592203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded5530-5eed-41a2-88b9-12e1275967ba None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:53.629075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d676e2-9b3b-4b75-bc14-580932eb1937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:53.629746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d676e2-9b3b-4b75-bc14-580932eb1937 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:53.630023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d676e2-9b3b-4b75-bc14-580932eb1937 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:53.630318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d676e2-9b3b-4b75-bc14-580932eb1937 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/b6fcc836589e441c85caba269357e4ce/roles/dfdbf88fc1e14740ba5405837f6bf2fc` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:53.632345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d676e2-9b3b-4b75-bc14-580932eb1937 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c43f8201b34f6a8c1765c89e41545c, user_id=b6fcc836589e441c85caba269357e4ce, role_id=dfdbf88fc1e14740ba5405837f6bf2fc)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:53.633797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d676e2-9b3b-4b75-bc14-580932eb1937 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:53.660331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 76/148] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:01:53 2022] PUT /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/users/b6fcc836589e441c85caba269357e4ce/roles/dfdbf88fc1e14740ba5405837f6bf2fc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:01:54.447620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305731-6720-4a84-bf73-7c74b2a6257d None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:54.447620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305731-6720-4a84-bf73-7c74b2a6257d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:54.447620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305731-6720-4a84-bf73-7c74b2a6257d None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:54.447620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 73/149] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:54.454623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a180-c18c-4692-8d1e-754ff5aa8b64 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:54.455038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a180-c18c-4692-8d1e-754ff5aa8b64 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:54.455254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a180-c18c-4692-8d1e-754ff5aa8b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:54.472327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:54.478436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d1d6a180-c18c-4692-8d1e-754ff5aa8b64 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:54.479631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d1d6a180-c18c-4692-8d1e-754ff5aa8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:54.560733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 77/150] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:54.598054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305731-6720-4a84-bf73-7c74b2a6257d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:54.739177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305731-6720-4a84-bf73-7c74b2a6257d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:54.755215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:54.784391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:54.785051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:54.785329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:54.785602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:54.801980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:54.807872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:54.808732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:54.809505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 74/151] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:54.817367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6a180-c18c-4692-8d1e-754ff5aa8b64 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:54.958432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6a180-c18c-4692-8d1e-754ff5aa8b64 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:55.000393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:55.001375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.001896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.002418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.003418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:55.004176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:55.005801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:55.008485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:55.015995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 78/152] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:55.021142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:55.161464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02b63-5baf-4406-910e-415959d9876f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:55.204293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814b5ad-faca-4d75-9f84-61be54574b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:55.204952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814b5ad-faca-4d75-9f84-61be54574b09 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.205232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814b5ad-faca-4d75-9f84-61be54574b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.205504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814b5ad-faca-4d75-9f84-61be54574b09 None admin] PATH_INFO: `/v3/users/f4a6891388094a448767f8355119febd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.206729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814b5ad-faca-4d75-9f84-61be54574b09 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a6891388094a448767f8355119febd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:55.208195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814b5ad-faca-4d75-9f84-61be54574b09 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:55.210665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 75/153] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:55 2022] GET /identity/v3/users/f4a6891388094a448767f8355119febd => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:55.216515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:55.363359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba77a9-ae30-416a-9a80-0ef41d6c9c3e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:55.408629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:55.409539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.409959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.410453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.489401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:55.493978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:55.495722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:55.584758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605735-468c-46d3-9a57-f8c6b216778a None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.585279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605735-468c-46d3-9a57-f8c6b216778a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.585279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605735-468c-46d3-9a57-f8c6b216778a None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.586808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 76/154] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:55.592271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f14fc1-212f-4c6d-a46b-a7d28355c5f5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.592558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f14fc1-212f-4c6d-a46b-a7d28355c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.592836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f14fc1-212f-4c6d-a46b-a7d28355c5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.632018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d4f14fc1-212f-4c6d-a46b-a7d28355c5f5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:55.633307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d4f14fc1-212f-4c6d-a46b-a7d28355c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:55.636264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 79/155] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:55.641866 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:55.678033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:55.741367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 77/156] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:55.742309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4044f3-98f1-4551-8cfe-3ecc5ca80ec3 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.742600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4044f3-98f1-4551-8cfe-3ecc5ca80ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.742889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4044f3-98f1-4551-8cfe-3ecc5ca80ec3 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.744139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 78/157] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:55.758255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1d9e3-9889-4a42-bc93-60f704cd2f5a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.758255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1d9e3-9889-4a42-bc93-60f704cd2f5a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.758255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1d9e3-9889-4a42-bc93-60f704cd2f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.785024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-03b1d9e3-9889-4a42-bc93-60f704cd2f5a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:55.786353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-03b1d9e3-9889-4a42-bc93-60f704cd2f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:55.836541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:55.848400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2195-7e90-4662-b1be-177abdca1932 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:55.926303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 79/158] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:55.927197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1d9e3-9889-4a42-bc93-60f704cd2f5a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:55.935860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:55.936521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:55.936810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:55.937082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:55.942958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:55.945000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:55.947043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 80/159] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:55 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:55.957116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:56.121814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:56.127742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1d9e3-9889-4a42-bc93-60f704cd2f5a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:56.137046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3f9e5-4379-4c38-a775-f1d86aab4bfb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:56.187020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:56.187606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.187889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.188165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.203375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:56.208417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:56.209317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:56.210209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 80/160] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:56.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:56.225305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1327e-8541-4518-8d1c-18f157f04598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:56.225994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1327e-8541-4518-8d1c-18f157f04598 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.226294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1327e-8541-4518-8d1c-18f157f04598 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.226566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1327e-8541-4518-8d1c-18f157f04598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.227362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1327e-8541-4518-8d1c-18f157f04598 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=f4a6891388094a448767f8355119febd) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:56.227721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1327e-8541-4518-8d1c-18f157f04598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:56.229213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1327e-8541-4518-8d1c-18f157f04598 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:56.245096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 81/161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:55 2022] GET /identity/v3/role_assignments?user.id=f4a6891388094a448767f8355119febd&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:01:56.246512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bd0e-b6ce-4dce-bf39-44586c296315 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.246799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bd0e-b6ce-4dce-bf39-44586c296315 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.247071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bd0e-b6ce-4dce-bf39-44586c296315 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.248297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 82/162] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:56.248993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68bd0e-b6ce-4dce-bf39-44586c296315 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:56.314706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:56.367714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402be54b-df0d-4ccf-a16f-325180245a4c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:56.414427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20571c-912e-4fe8-8e35-afd31b661e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:56.415107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20571c-912e-4fe8-8e35-afd31b661e2c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.415387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20571c-912e-4fe8-8e35-afd31b661e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.415659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20571c-912e-4fe8-8e35-afd31b661e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.440415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20571c-912e-4fe8-8e35-afd31b661e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-4e20571c-912e-4fe8-8e35-afd31b661e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:56.445585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:56.446643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:01:56.447428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:56.454965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 81/163] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:56.456413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067fd8-9c45-4900-af8b-11cf94a7e669 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.456707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067fd8-9c45-4900-af8b-11cf94a7e669 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.456997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067fd8-9c45-4900-af8b-11cf94a7e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.476856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68bd0e-b6ce-4dce-bf39-44586c296315 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:56.481994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-68067fd8-9c45-4900-af8b-11cf94a7e669 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:56.483243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-68067fd8-9c45-4900-af8b-11cf94a7e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:56.498124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:56.560786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:56.561413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.561876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.562315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.563221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:56.563738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:56.565289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:56.586075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 82/164] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:56.587078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067fd8-9c45-4900-af8b-11cf94a7e669 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:56.589411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 83/165] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:56.595383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:56.695756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067fd8-9c45-4900-af8b-11cf94a7e669 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:56.737398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:56.738033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.738337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.738616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.739344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:56.739651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:56.741905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:56.760700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 83/166] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:56.761642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:56.787696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:56.792738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:56.811127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5a26-5c01-43ef-829e-472c77f14129 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:56.882268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:56.882929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.883214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.883491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:56.885341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:56.886896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:56.888524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 84/167] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:56 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:56.892260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:56.936259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf4e5e-fbd4-4e92-a10e-fb025f5839bb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:56.975633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:56.976254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:56.976540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:56.976815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.026873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:57.032360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:57.033267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:57.034126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 84/168] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:01:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:57.034849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:57.127850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd22fc-aeb4-4560-ba13-8a169c373807 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:57.154642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:57.219111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b269-0f24-43df-ab58-137494ec67a2 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:57.223012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:57.223697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.223997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.224256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.226108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:57.227903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:57.229760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 85/169] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:56 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:57.235611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:57.259273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:57.260259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.260739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.261237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.296560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:57.334814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:57.336644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:57.408284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:57.417806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77abef7-8067-4f06-abb5-f4761dc9023e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:57.442521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 85/170] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:57.443765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:57.460204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:57.460837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.461186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.461487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.462490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:57.462614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:57.463972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:57.473328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 86/171] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:01:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:57.474292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:57.557400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608599-11dc-40fc-aa68-67ea7e49ab10 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:57.603617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5734-b5d2-4d94-ae68-339ac247c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:57.604932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5734-b5d2-4d94-ae68-339ac247c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.605382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5734-b5d2-4d94-ae68-339ac247c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.605811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5734-b5d2-4d94-ae68-339ac247c2c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.658280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:57.658804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:57.674638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0fa3c-4bcd-4fa9-b5e7-d7c4acb82ac8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:57.694613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e5734-b5d2-4d94-ae68-339ac247c2c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:57.696853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e5734-b5d2-4d94-ae68-339ac247c2c6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:57.723074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:57.723960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.724413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.724943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] PATH_INFO: `/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.726850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] RBAC: Authorizing `identity:get_project(project_id=a2848e011eaf4104bbe3968ac0ee9b73)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:57.728731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:57.731041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 87/172] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:57 2022] GET /identity/v3/projects/a2848e011eaf4104bbe3968ac0ee9b73 => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:57.732785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:57.850001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 86/173] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:57.851557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8064-6c1f-4b25-bae5-60b8a4c19b30 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.852834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8064-6c1f-4b25-bae5-60b8a4c19b30 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.853237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8064-6c1f-4b25-bae5-60b8a4c19b30 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.854948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 87/174] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:57.856936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8e7c-db2c-46a3-9bd4-7011cc6897d3 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.857323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8e7c-db2c-46a3-9bd4-7011cc6897d3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.857701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8e7c-db2c-46a3-9bd4-7011cc6897d3 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.860941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 88/175] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:57.865611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8e7c-db2c-46a3-9bd4-7011cc6897d3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:57.877260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62fdbd-6d04-47b3-804d-559193c2be5b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:57.927349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:57.928113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:57.928434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:57.928807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] PATH_INFO: `/v3/users/75ab0515763a46178ee145ae4a916195` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:57.931051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] RBAC: Authorizing `identity:get_user(user_id=75ab0515763a46178ee145ae4a916195)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:57.932858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:57.935376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 88/176] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:57 2022] GET /identity/v3/users/75ab0515763a46178ee145ae4a916195 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:57.936053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:57.950211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:57.979150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:57.988717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8e7c-db2c-46a3-9bd4-7011cc6897d3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.024930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4271-1a70-426c-8f5a-68c457267f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.025553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4271-1a70-426c-8f5a-68c457267f7d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.025833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4271-1a70-426c-8f5a-68c457267f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.026108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4271-1a70-426c-8f5a-68c457267f7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.026920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4271-1a70-426c-8f5a-68c457267f7d None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=a2848e011eaf4104bbe3968ac0ee9b73, user.id=75ab0515763a46178ee145ae4a916195) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:58.027238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4271-1a70-426c-8f5a-68c457267f7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:58.028680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4271-1a70-426c-8f5a-68c457267f7d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:58.034398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 89/177] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:57 2022] GET /identity/v3/role_assignments?user.id=75ab0515763a46178ee145ae4a916195&scope.project.id=a2848e011eaf4104bbe3968ac0ee9b73&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:58.046423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653570-08c7-4234-9e3b-7d8e3e996b29 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.046423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653570-08c7-4234-9e3b-7d8e3e996b29 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.046423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653570-08c7-4234-9e3b-7d8e3e996b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.054920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3c653570-08c7-4234-9e3b-7d8e3e996b29 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:58.056187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3c653570-08c7-4234-9e3b-7d8e3e996b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:58.062305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaec53-692b-40b0-901a-494f05918c08 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.104777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3ee87-0d5c-4791-8ce5-e42ce882a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.105358 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ee87-0d5c-4791-8ce5-e42ce882a282 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.105636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ee87-0d5c-4791-8ce5-e42ce882a282 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.105954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ee87-0d5c-4791-8ce5-e42ce882a282 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.107181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3ee87-0d5c-4791-8ce5-e42ce882a282 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:58.108671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3ee87-0d5c-4791-8ce5-e42ce882a282 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:58.110437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 89/178] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:57 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:58.111701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdad64-5283-4dbb-8bc0-933e674d61c7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.111983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdad64-5283-4dbb-8bc0-933e674d61c7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.112254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdad64-5283-4dbb-8bc0-933e674d61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.133038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-55cdad64-5283-4dbb-8bc0-933e674d61c7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:58.134275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-55cdad64-5283-4dbb-8bc0-933e674d61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:58.143975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 90/179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:58.155328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653570-08c7-4234-9e3b-7d8e3e996b29 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.211545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 90/180] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:58.212800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36175d67-7de6-4f28-9e5e-1b7f19ed5624 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.213082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36175d67-7de6-4f28-9e5e-1b7f19ed5624 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.213351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36175d67-7de6-4f28-9e5e-1b7f19ed5624 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.214699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 91/181] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:58.215706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe467b-aae4-4deb-95fb-a19e4a256e27 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.219045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe467b-aae4-4deb-95fb-a19e4a256e27 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.219566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe467b-aae4-4deb-95fb-a19e4a256e27 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.220961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 92/182] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:01:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:01:58.221864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe467b-aae4-4deb-95fb-a19e4a256e27 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.247266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:58.249691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:58.289610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653570-08c7-4234-9e3b-7d8e3e996b29 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.323966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772f3e-5aeb-41d9-94ff-aad958e6d273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.324590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772f3e-5aeb-41d9-94ff-aad958e6d273 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.324866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772f3e-5aeb-41d9-94ff-aad958e6d273 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.325132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772f3e-5aeb-41d9-94ff-aad958e6d273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.335762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe467b-aae4-4deb-95fb-a19e4a256e27 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.369155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.369697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.369971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.370260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.371057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=75ab0515763a46178ee145ae4a916195) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:58.371364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:58.372807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:58.378384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 93/183] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/role_assignments?user.id=75ab0515763a46178ee145ae4a916195&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:58.379407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.395032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7772f3e-5aeb-41d9-94ff-aad958e6d273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:58.396603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7772f3e-5aeb-41d9-94ff-aad958e6d273 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:58.467087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:58.485437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:58.501144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c681d6f-0c8e-42e5-ba2c-4a6ad413b5d1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.512206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 91/184] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:58.518277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43924d-6da7-41bd-afe3-706d94dd838a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.518573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43924d-6da7-41bd-afe3-706d94dd838a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.518834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43924d-6da7-41bd-afe3-706d94dd838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.537993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-0e43924d-6da7-41bd-afe3-706d94dd838a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:58.539242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0e43924d-6da7-41bd-afe3-706d94dd838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:58.546130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b2a9-6146-4c03-a5c0-bedfc704ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.547325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b2a9-6146-4c03-a5c0-bedfc704ce3b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.548476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b2a9-6146-4c03-a5c0-bedfc704ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.548963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b2a9-6146-4c03-a5c0-bedfc704ce3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.563443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b2a9-6146-4c03-a5c0-bedfc704ce3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ab80b2a9-6146-4c03-a5c0-bedfc704ce3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:58.568836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:58.569750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:01:58.570590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 94/185] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:58.573192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878bb7a-136e-4a03-a3c7-c3e4a06740e7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.573471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878bb7a-136e-4a03-a3c7-c3e4a06740e7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.573740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878bb7a-136e-4a03-a3c7-c3e4a06740e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.596450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2878bb7a-136e-4a03-a3c7-c3e4a06740e7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:01:58.597949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2878bb7a-136e-4a03-a3c7-c3e4a06740e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:01:58.620429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 92/186] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:58.621214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43924d-6da7-41bd-afe3-706d94dd838a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.678562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 95/187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:01:58.679461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878bb7a-136e-4a03-a3c7-c3e4a06740e7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.719938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:58.727538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43924d-6da7-41bd-afe3-706d94dd838a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.755482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:58.763279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.763920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.764200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.764474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.774764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:58.777019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878bb7a-136e-4a03-a3c7-c3e4a06740e7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:58.779666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:58.780557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:58.781444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 93/188] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:58.782091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.811255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.811895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.812174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.812444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.813585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:58.815053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:58.816848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 96/189] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:58.819097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.883632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04123-6b6d-4b31-bd3e-1d8c57b86e32 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.915245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2da3c-b354-4591-8e5f-4016c9cc13c4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:58.917105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.917749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.918031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.918338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.919052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:58.919359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:58.920740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:58.928912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 94/190] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:58.929585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.947494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:58.947937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:58.948549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:58.948849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:58.949083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:58.950363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:58.951808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:58.953367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 97/191] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:58.954116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:58.977280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.030149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9977e0-a9e9-40e7-9eb2-6c88baa054b8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.059708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb877-629e-4ec1-90de-d4d6b1bd1c13 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.063118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.063757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.064041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.064316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.074277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:01:59.079624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:01:59.080465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:01:59.081426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 95/192] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:01:59.083420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.094782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.095399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.095676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.095945 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.096734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:59.097038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.098456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.108325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 98/193] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:01:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:59.109126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.165997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.184541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.189963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e34d6-e3c6-4026-95c9-465fb21398c1 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.208098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e392e-8f34-4545-8e42-9aaa0c839f86 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.223189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.223904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.224284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.224625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.225481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] RBAC: Adding query filter params (role.id=16d20d9321574453897849a9f649b636, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=75ab0515763a46178ee145ae4a916195) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:59.225860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.227424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.247360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 96/194] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/role_assignments?user.id=75ab0515763a46178ee145ae4a916195&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=16d20d9321574453897849a9f649b636 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:59.247360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.247679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.247679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.247679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.247679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] PATH_INFO: `/v3/users/67c1feefaad44a81b4370d81dc26c5dd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.261204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] RBAC: Authorizing `identity:get_user(user_id=67c1feefaad44a81b4370d81dc26c5dd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.262767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.264559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 99/195] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/users/67c1feefaad44a81b4370d81dc26c5dd => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:59.264559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.352545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54024122-09fd-4626-b0b9-070f9c1b337e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.382797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf46c-a46a-4742-90da-c866adcc1482 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.388635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.389198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.389479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.389745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.390448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.391885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.403694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.422415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 97/196] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:01:59 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:01:59.423608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.432449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65259741-d059-4152-9b69-02c664003744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.433087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65259741-d059-4152-9b69-02c664003744 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.433365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65259741-d059-4152-9b69-02c664003744 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.433636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65259741-d059-4152-9b69-02c664003744 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.434436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65259741-d059-4152-9b69-02c664003744 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:01:59.434739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65259741-d059-4152-9b69-02c664003744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.436148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65259741-d059-4152-9b69-02c664003744 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.438017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.449427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 100/197] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:59.450331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65259741-d059-4152-9b69-02c664003744 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.545618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4edbe4-e6db-476f-95d0-ecae50db38b3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.582794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65259741-d059-4152-9b69-02c664003744 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.585130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.585790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.586061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.586365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] PATH_INFO: `/v3/users/b6fcc836589e441c85caba269357e4ce` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.587563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] RBAC: Authorizing `identity:get_user(user_id=b6fcc836589e441c85caba269357e4ce)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.589010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.590652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 98/198] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/users/b6fcc836589e441c85caba269357e4ce => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:59.595430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.625338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.626654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.626654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.626654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.670084 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.707379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.718073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.719584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.719718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb08a5-7caf-4e6e-ab08-ac5228df8210 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.763616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.764364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.764646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.764920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] PATH_INFO: `/v3/users/67c1feefaad44a81b4370d81dc26c5dd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.766085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] RBAC: Authorizing `identity:get_user(user_id=67c1feefaad44a81b4370d81dc26c5dd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:01:59.767576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:01:59.769302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 99/199] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/users/67c1feefaad44a81b4370d81dc26c5dd => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:01:59.770054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.867254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 101/200] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:01:59.868207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:01:59.902546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ef39f-648d-4ed9-81eb-7cd7473c488a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:01:59.935321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:01:59.941487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:01:59.942248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:01:59.942646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:01:59.943060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:01:59.996584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:00.005349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55e2d3-ec11-47d9-8956-41171fc94c3d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:00.021376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.023170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.046621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:00.047486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:00.047858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:00.048243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:00.136514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.139561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.156242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:00.157262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:00.192055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:00.262565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:00.267608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ed5-c398-492f-a0a3-a05ac9b1b516 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:00.272783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 102/202] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:00.272783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:00.318792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:00.320111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:00.320614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:00.321351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:00.323633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.326063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.328524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 101/203] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:00 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:00.329511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:00.391210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70d445-82f2-473b-872f-d2a6cd40390a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:00.442669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:00.443751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:00.444756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:00.445241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:00.445725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:00.446161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0856e9-b6a0-4196-ae46-2b84f45770db None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:00.447394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.450727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.452620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 103/204] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:00 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:00.453575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:00.493561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:00.494270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:00.494606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:00.494873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:00.496062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.497721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.504536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 102/205] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:00 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:00.504536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:00.535019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:00.589164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4146-eaa7-4025-a899-b13e99790d38 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:00.623153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b17d-e28a-40e0-9a26-c8ed1adf81ee None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:00.637213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:00.638800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:00.639266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:00.639854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:00.640918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=67c1feefaad44a81b4370d81dc26c5dd) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:00.641643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.646752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.655182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 104/206] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:00 2022] GET /identity/v3/role_assignments?user.id=67c1feefaad44a81b4370d81dc26c5dd&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:00.656243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:00.680501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac7c73-6890-4f72-8d7a-6bed80a19eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:00.681849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7c73-6890-4f72-8d7a-6bed80a19eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:00.682345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7c73-6890-4f72-8d7a-6bed80a19eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:00.682798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7c73-6890-4f72-8d7a-6bed80a19eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:00.684075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac7c73-6890-4f72-8d7a-6bed80a19eb0 None admin] RBAC: Adding query filter params (role.id=dfdbf88fc1e14740ba5405837f6bf2fc, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c, user.id=b6fcc836589e441c85caba269357e4ce) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:00.684615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac7c73-6890-4f72-8d7a-6bed80a19eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.686322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac7c73-6890-4f72-8d7a-6bed80a19eb0 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.694787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 103/207] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:00 2022] GET /identity/v3/role_assignments?user.id=b6fcc836589e441c85caba269357e4ce&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=dfdbf88fc1e14740ba5405837f6bf2fc => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:00.800569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe6a2-568e-41a3-b837-215fb83719f7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:00.831311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:00.839839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3b770-8aa1-4619-9bfd-3c639e3fbc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:00.840476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3b770-8aa1-4619-9bfd-3c639e3fbc33 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:00.840756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3b770-8aa1-4619-9bfd-3c639e3fbc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:00.841025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3b770-8aa1-4619-9bfd-3c639e3fbc33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:00.841817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3b770-8aa1-4619-9bfd-3c639e3fbc33 None admin] RBAC: Adding query filter params (role.id=16d20d9321574453897849a9f649b636, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=67c1feefaad44a81b4370d81dc26c5dd) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:00.842120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3b770-8aa1-4619-9bfd-3c639e3fbc33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:00.843617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3b770-8aa1-4619-9bfd-3c639e3fbc33 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:00.854426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 105/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:00 2022] GET /identity/v3/role_assignments?user.id=67c1feefaad44a81b4370d81dc26c5dd&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=16d20d9321574453897849a9f649b636 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:01.606357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea62d9-665d-4994-8820-4b2852f68a39 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:01.607036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea62d9-665d-4994-8820-4b2852f68a39 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:01.607549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea62d9-665d-4994-8820-4b2852f68a39 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:01.609364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 104/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:01.614896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20369-a72c-4750-ad25-466419c9895f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:01.615411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20369-a72c-4750-ad25-466419c9895f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:01.615905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20369-a72c-4750-ad25-466419c9895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:01.635126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c9b20369-a72c-4750-ad25-466419c9895f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:01.636606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c9b20369-a72c-4750-ad25-466419c9895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:01.705387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:01.729030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea62d9-665d-4994-8820-4b2852f68a39 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:01.729625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87eec-3fc2-4e38-ab9d-d01610bc5d90 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:01.729882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87eec-3fc2-4e38-ab9d-d01610bc5d90 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:01.730153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87eec-3fc2-4e38-ab9d-d01610bc5d90 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:01.731642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 107/211] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:01.736712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515047-b0d7-4a0d-bf16-430b7a0badf8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:01.736992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515047-b0d7-4a0d-bf16-430b7a0badf8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:01.737263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515047-b0d7-4a0d-bf16-430b7a0badf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:01.756296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b2515047-b0d7-4a0d-bf16-430b7a0badf8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:01.757506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b2515047-b0d7-4a0d-bf16-430b7a0badf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:01.766193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:01.830482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:01.852637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea62d9-665d-4994-8820-4b2852f68a39 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:01.855230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515047-b0d7-4a0d-bf16-430b7a0badf8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:01.897091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:01.898292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:01.898704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:01.898980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:01.909848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:01.916812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:01.917704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:01.918547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:01.924054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:01.924651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:01.924760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:01.988885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515047-b0d7-4a0d-bf16-430b7a0badf8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:02.040613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:02.041290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.041570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.041841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.043666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:02.043776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:02.045181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:02.050372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:02.053424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:02.063143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc312ac-848b-4d00-b4d1-34cb1409ab50 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:02.106837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:02.107474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.107757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.108034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.108763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] RBAC: Adding query filter params (name=member) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:02.109070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:02.110503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:02.128903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:02.131095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:02.198594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456f430-31f4-4a62-908b-64d2c4773f3e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:02.226555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:02.242732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:02.243620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.244193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.244663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.245561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:02.247292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:02.261513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796bb8e-e727-47f5-8119-268f1eeba428 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:02.273910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 110/216] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:02 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:02:02.311250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:02.312297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.312874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.313352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] PATH_INFO: `/v3/users/ee524a3bc7ea4f0c94710a6611806b53` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.331544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=ee524a3bc7ea4f0c94710a6611806b53)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:02.333524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:02.335653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 107/217] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:02 2022] GET /identity/v3/users/ee524a3bc7ea4f0c94710a6611806b53 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:02.341499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:02.456932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6239869-4ee9-4c7f-adb8-afa3f54f1512 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:02.494972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:02.495612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.495896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.496317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.545438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:02.579702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:02.581227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:02.691673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 111/218] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 22:02:02.696923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:02.714031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:02.810502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb4cdb-d0bb-4796-8f32-20a6be61e5b3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:02.859088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be107cdd-5209-4db6-a246-f6af0c980512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:02.860106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be107cdd-5209-4db6-a246-f6af0c980512 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.860629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be107cdd-5209-4db6-a246-f6af0c980512 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.861114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be107cdd-5209-4db6-a246-f6af0c980512 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.866976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be107cdd-5209-4db6-a246-f6af0c980512 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:02.868757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be107cdd-5209-4db6-a246-f6af0c980512 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:02.870727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 108/219] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:02 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:02.876661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:02.893463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993684-4bab-4f36-917e-7ce2fa891ab5 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.894080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993684-4bab-4f36-917e-7ce2fa891ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.894604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993684-4bab-4f36-917e-7ce2fa891ab5 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.896942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 109/220] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:02.903144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96563-3a4e-49f6-843f-9cd29d1cc0e6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:02.903420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96563-3a4e-49f6-843f-9cd29d1cc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:02.903692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96563-3a4e-49f6-843f-9cd29d1cc0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:02.928363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-30b96563-3a4e-49f6-843f-9cd29d1cc0e6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:02.929548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-30b96563-3a4e-49f6-843f-9cd29d1cc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:02.978771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:03.000623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f14ba7-bf43-43b6-a9dc-fec3571b2baf None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:03.032817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 110/221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:03.035377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e621e1-44bc-441f-959c-3a494b63bbe1 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.035904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e621e1-44bc-441f-959c-3a494b63bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.036400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e621e1-44bc-441f-959c-3a494b63bbe1 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.037898 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 111/222] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:03.046264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0a32-be56-4f23-b949-656609578392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:03.046264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0a32-be56-4f23-b949-656609578392 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.046264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0a32-be56-4f23-b949-656609578392 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.046264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0a32-be56-4f23-b949-656609578392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.046620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0a32-be56-4f23-b949-656609578392 None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=ee524a3bc7ea4f0c94710a6611806b53) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:03.046620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0a32-be56-4f23-b949-656609578392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:03.047068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0a32-be56-4f23-b949-656609578392 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:03.048446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae802c-b8ae-467e-a708-b69ee99bd533 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.049266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae802c-b8ae-467e-a708-b69ee99bd533 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.049756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae802c-b8ae-467e-a708-b69ee99bd533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.057821 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 112/223] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:02 2022] GET /identity/v3/role_assignments?user.id=ee524a3bc7ea4f0c94710a6611806b53&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:03.060501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0a32-be56-4f23-b949-656609578392 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:03.074435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-04ae802c-b8ae-467e-a708-b69ee99bd533 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:03.075748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-04ae802c-b8ae-467e-a708-b69ee99bd533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:03.078973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:03.183594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0a32-be56-4f23-b949-656609578392 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:03.199136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 112/224] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:03.221269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae802c-b8ae-467e-a708-b69ee99bd533 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:03.264036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:03.264608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.264884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.265148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.287440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:03.295659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:03.300395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:03.301268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:03.302056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:03.303945 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 113/225] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:03.309846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:03.364609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae802c-b8ae-467e-a708-b69ee99bd533 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:03.447543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:03.447924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b5f1-811a-4f8b-a307-2c2f2e657ea4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:03.448219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.448503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.448777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.471223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:03.474802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:03.479891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:03.480824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:03.481614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:03.487705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 113/226] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:03.490755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:03.491378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.491653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.491917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.492641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:03.492941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:03.494330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:03.508439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 114/227] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:03.509170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:03.514953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:03.587330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:03.627218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911ea9-dd01-4cf4-8097-86acc09a026a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:03.665105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:03.666586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.667224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.669866 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] PATH_INFO: `/v3/users/67c1feefaad44a81b4370d81dc26c5dd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.671269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=67c1feefaad44a81b4370d81dc26c5dd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:03.672892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:03.675643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:03 2022] GET /identity/v3/users/67c1feefaad44a81b4370d81dc26c5dd => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:03.681886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:03.736730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c3a8-1387-4676-adc2-f2bbb89cb161 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:03.815027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:03.815626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.815855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.816106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.816892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:03.817123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:03.818592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:03.836451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 114/229] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:03.842136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:03.843149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3612a-c84e-4445-bb8d-c54442070cb9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:03.875150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:03.885149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:03.889965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:03.890579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:03.891048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:03.892644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:03.895181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:03.906258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:03 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:03.908730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:04.014538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:04.066763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e7166-0886-4a98-943a-6edb6701db75 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:04.096140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fad593-ee74-4e20-b9ed-a8bdca9cb497 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:04.111012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:04.112258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.112748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.113270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] PATH_INFO: `/v3/users/67c1feefaad44a81b4370d81dc26c5dd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.114746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] RBAC: Authorizing `identity:get_user(user_id=67c1feefaad44a81b4370d81dc26c5dd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:04.116444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:04.122492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 115/231] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:03 2022] GET /identity/v3/users/67c1feefaad44a81b4370d81dc26c5dd => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:04.125059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:04.169366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:04.171227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.171711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.172169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da/users/67c1feefaad44a81b4370d81dc26c5dd/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.176117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3656add4314844e9b72312ec211f48da, user_id=67c1feefaad44a81b4370d81dc26c5dd, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:04.177599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:04.204271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 117/232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:03 2022] PUT /identity/v3/projects/3656add4314844e9b72312ec211f48da/users/67c1feefaad44a81b4370d81dc26c5dd/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:04.311680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d34e30-b93f-4840-a22e-649ee9eea661 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:04.357150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:04.364346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968fd1-43a8-49ed-8ce0-8cd15b754409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:04.365053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968fd1-43a8-49ed-8ce0-8cd15b754409 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.365333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968fd1-43a8-49ed-8ce0-8cd15b754409 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.365603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968fd1-43a8-49ed-8ce0-8cd15b754409 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.366794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968fd1-43a8-49ed-8ce0-8cd15b754409 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:04.368255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968fd1-43a8-49ed-8ce0-8cd15b754409 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:04.370132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 116/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:04 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:04.378177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:04.446446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:04.509817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e1c01-d03e-4df4-8399-7a9edff75ef0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:04.561049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8340d-77aa-415d-aa18-8a9c3f6898ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:04.562103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8340d-77aa-415d-aa18-8a9c3f6898ef None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.562613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8340d-77aa-415d-aa18-8a9c3f6898ef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.563095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8340d-77aa-415d-aa18-8a9c3f6898ef None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da/users/67c1feefaad44a81b4370d81dc26c5dd/roles/16d20d9321574453897849a9f649b636` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.565513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8340d-77aa-415d-aa18-8a9c3f6898ef None admin] RBAC: Authorizing `identity:create_grant(project_id=3656add4314844e9b72312ec211f48da, user_id=67c1feefaad44a81b4370d81dc26c5dd, role_id=16d20d9321574453897849a9f649b636)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:04.567279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8340d-77aa-415d-aa18-8a9c3f6898ef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:04.595996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:04 2022] PUT /identity/v3/projects/3656add4314844e9b72312ec211f48da/users/67c1feefaad44a81b4370d81dc26c5dd/roles/16d20d9321574453897849a9f649b636 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:04.836500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85708f9-2231-4059-916b-6708f57f0361 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.837018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85708f9-2231-4059-916b-6708f57f0361 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.837018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85708f9-2231-4059-916b-6708f57f0361 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.838669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:04.843784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76283a1-b25c-4689-8f8e-5c69ec1de331 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.844304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76283a1-b25c-4689-8f8e-5c69ec1de331 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.844796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76283a1-b25c-4689-8f8e-5c69ec1de331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.868884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d76283a1-b25c-4689-8f8e-5c69ec1de331 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:04.870078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d76283a1-b25c-4689-8f8e-5c69ec1de331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:04.898208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b4ae8-5a31-430a-a64d-e260e5418c95 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.898530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b4ae8-5a31-430a-a64d-e260e5418c95 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.898787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b4ae8-5a31-430a-a64d-e260e5418c95 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.900380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 118/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:04.905445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635b401-ed03-4f2d-b178-3baa4a9d2fd9 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:04.905730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635b401-ed03-4f2d-b178-3baa4a9d2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:04.906011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635b401-ed03-4f2d-b178-3baa4a9d2fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:04.924548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f635b401-ed03-4f2d-b178-3baa4a9d2fd9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:04.925742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f635b401-ed03-4f2d-b178-3baa4a9d2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:04.968291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 119/237] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:04.991852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76283a1-b25c-4689-8f8e-5c69ec1de331 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:05.027012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 119/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:05.055157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635b401-ed03-4f2d-b178-3baa4a9d2fd9 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:05.090920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:05.165613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635b401-ed03-4f2d-b178-3baa4a9d2fd9 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:05.196878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:05.203723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:05.204634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.206262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.206262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.207859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:05.215858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:05.217706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 120/239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:05.224700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76283a1-b25c-4689-8f8e-5c69ec1de331 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:05.225748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:05.264340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:05.265755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.266213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.266706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.280667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:05.287247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:05.288137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:05.288929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:05.291362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:05.299357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:05.426387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c89ef-67dc-4fc7-acdb-44ea4aafe597 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:05.463131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7926-e769-451d-9bd9-13ade9a6f86c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:05.482621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:05.501115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:05.501740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.502067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.502378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.503251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:05.503832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:05.505716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:05.514859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 121/241] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:05.520782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:05.558951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf49682-d0bb-4924-9c98-cf505b09cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:05.559677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49682-d0bb-4924-9c98-cf505b09cd5e None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.559958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49682-d0bb-4924-9c98-cf505b09cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.560224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49682-d0bb-4924-9c98-cf505b09cd5e None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.560933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf49682-d0bb-4924-9c98-cf505b09cd5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:05.562408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf49682-d0bb-4924-9c98-cf505b09cd5e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:05.593281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 121/242] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:05 2022] POST /identity/v3/users => generated 293 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:02:05.595219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5717-5af8-401a-aa0e-a21920dc699a None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.595653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5717-5af8-401a-aa0e-a21920dc699a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.595934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5717-5af8-401a-aa0e-a21920dc699a None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.597300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 122/243] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:05.604129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f573b-f3ae-473f-b9e2-d34d14e1233a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.604788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f573b-f3ae-473f-b9e2-d34d14e1233a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.605068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f573b-f3ae-473f-b9e2-d34d14e1233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.629332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-051f573b-f3ae-473f-b9e2-d34d14e1233a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:05.631205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-051f573b-f3ae-473f-b9e2-d34d14e1233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:05.674593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6b2d6-0b72-4f89-9b42-dcc48a903033 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:05.725731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:05.732662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:05.733562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.734078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.734543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] PATH_INFO: `/v3/users/cb4a37636df34cee9686034564785837` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.754259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] RBAC: Authorizing `identity:get_user(user_id=cb4a37636df34cee9686034564785837)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:05.757174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:05.760106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 122/244] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:05 2022] GET /identity/v3/users/cb4a37636df34cee9686034564785837 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:05.765472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:05.779778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 123/245] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:05.803571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:05.820826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f573b-f3ae-473f-b9e2-d34d14e1233a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:05.897615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b88e5-9dae-407b-bd8a-5ab6f9007a47 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:05.935561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f573b-f3ae-473f-b9e2-d34d14e1233a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:05.939139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:05.940053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.940728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.941199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.980846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:05.980846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:05.980846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:05.980846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:05.993381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:05.998746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:05.999646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:06.000504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 124/246] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:06.008479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:06.043225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:06.044789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:06.063757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:06.078922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:06.157848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22458-4de6-4c3a-9db7-600838a8cf9e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:06.182846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 123/247] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:06.190931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:06.202079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:06.202278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.202521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.202750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.203467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] RBAC: Adding query filter params (name=member) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:06.203770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:06.205270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:06.216094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 125/248] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:06.221630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:06.327154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d6c59-cf4f-4a40-b5dd-491b8326e1fd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:06.363160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:06.366638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b477e-ed71-4aa3-84fa-a3a7e9d6142d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:06.370427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:06.379585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:06.380273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.380550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.380818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.382438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:06.384179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:06.389315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 124/249] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:06 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:06.394622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:06.415425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:06.416414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.416919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.417444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] PATH_INFO: `/v3/users/ee524a3bc7ea4f0c94710a6611806b53` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.418941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] RBAC: Authorizing `identity:get_user(user_id=ee524a3bc7ea4f0c94710a6611806b53)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:06.420697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:06.422857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 126/250] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:06 2022] GET /identity/v3/users/ee524a3bc7ea4f0c94710a6611806b53 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:06.431716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:06.519933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9e864-fa37-4c52-a235-a0a58c1cbc4a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:06.557393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:06.557856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.558189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.558503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.559317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] RBAC: Adding query filter params (role.id=dfdbf88fc1e14740ba5405837f6bf2fc, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=cb4a37636df34cee9686034564785837) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:06.559591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:06.561021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:06.566803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 125/251] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:06 2022] GET /identity/v3/role_assignments?user.id=cb4a37636df34cee9686034564785837&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=dfdbf88fc1e14740ba5405837f6bf2fc => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:06.568932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d40042-f461-4f91-a1ea-c969a515ec53 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:06.609239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de0565-9724-4b35-b324-fccc17d2f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:06.609905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de0565-9724-4b35-b324-fccc17d2f478 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.610186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de0565-9724-4b35-b324-fccc17d2f478 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.610484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de0565-9724-4b35-b324-fccc17d2f478 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.611677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de0565-9724-4b35-b324-fccc17d2f478 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:06.613146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de0565-9724-4b35-b324-fccc17d2f478 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:06.615249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 127/252] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:06 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:06.621120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:06.699046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:06.744030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572ea27-5b8d-4a73-b18c-f7012f827232 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:06.781419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe3548-f98f-4dbe-bcdb-33704e0415b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:06.782110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3548-f98f-4dbe-bcdb-33704e0415b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.782417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3548-f98f-4dbe-bcdb-33704e0415b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.782686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3548-f98f-4dbe-bcdb-33704e0415b1 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da/users/ee524a3bc7ea4f0c94710a6611806b53/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.784705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe3548-f98f-4dbe-bcdb-33704e0415b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3656add4314844e9b72312ec211f48da, user_id=ee524a3bc7ea4f0c94710a6611806b53, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:06.786195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe3548-f98f-4dbe-bcdb-33704e0415b1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:06.815277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 126/253] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:06 2022] PUT /identity/v3/projects/3656add4314844e9b72312ec211f48da/users/ee524a3bc7ea4f0c94710a6611806b53/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:06.918158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc429-ce49-482f-9454-35db03b7560d None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.918369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc429-ce49-482f-9454-35db03b7560d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.918646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc429-ce49-482f-9454-35db03b7560d None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.920142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 128/254] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:06.925858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624c8c-3e68-455a-96ff-a11b92bb54f8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:06.926136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624c8c-3e68-455a-96ff-a11b92bb54f8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:06.926471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624c8c-3e68-455a-96ff-a11b92bb54f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:06.951388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-53624c8c-3e68-455a-96ff-a11b92bb54f8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:06.952572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-53624c8c-3e68-455a-96ff-a11b92bb54f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:07.042904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 127/255] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:07.083768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fc429-ce49-482f-9454-35db03b7560d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:07.136435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:07.200916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fc429-ce49-482f-9454-35db03b7560d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:07.235505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:07.236146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:07.236421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:07.236688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:07.247710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:07.253078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:07.254294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:07.256174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 129/256] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:07.267321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624c8c-3e68-455a-96ff-a11b92bb54f8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:07.331278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:07.391187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624c8c-3e68-455a-96ff-a11b92bb54f8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:07.436613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:07.437231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:07.437507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:07.437769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:07.438501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:07.438798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:07.440166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:07.453800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 128/257] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:07.459494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:07.570008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34ece-e5f7-4f89-b091-440c48d3b79b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:07.572525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:07.613135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ab99d-eec4-41e1-a22f-be1918012615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:07.613816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab99d-eec4-41e1-a22f-be1918012615 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:07.614093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab99d-eec4-41e1-a22f-be1918012615 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:07.614391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab99d-eec4-41e1-a22f-be1918012615 None admin] PATH_INFO: `/v3/users/67c1feefaad44a81b4370d81dc26c5dd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:07.616329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ab99d-eec4-41e1-a22f-be1918012615 None admin] RBAC: Authorizing `identity:get_user(user_id=67c1feefaad44a81b4370d81dc26c5dd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:07.617832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ab99d-eec4-41e1-a22f-be1918012615 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:07.619884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 130/258] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:07 2022] GET /identity/v3/users/67c1feefaad44a81b4370d81dc26c5dd => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:07.625811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:07.754652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ce3e-ebcf-4209-a779-020d908a81fd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:07.770459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:07.787992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab32e0d-b18f-4f95-8178-0cc50c4d12ac None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:07.788329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab32e0d-b18f-4f95-8178-0cc50c4d12ac None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:07.788538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab32e0d-b18f-4f95-8178-0cc50c4d12ac None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:07.789922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 131/259] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:07.795799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe475894-1bad-4b89-866c-be915da66b50 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:07.796168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe475894-1bad-4b89-866c-be915da66b50 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:07.796419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe475894-1bad-4b89-866c-be915da66b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:07.819826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:07.820451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:07.820726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:07.820995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:07.828363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fe475894-1bad-4b89-866c-be915da66b50 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:07.829540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fe475894-1bad-4b89-866c-be915da66b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:07.943072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:07.944538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:08.019868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 132/260] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:08.059286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe475894-1bad-4b89-866c-be915da66b50 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:08.064523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 129/261] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:08.070063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:08.087697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:08.225409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6de34d-9e22-45ff-b30a-f65435f53c58 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:08.238589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:08.243747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe475894-1bad-4b89-866c-be915da66b50 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:08.281910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:08.282636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:08.282804 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:08.283038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:08.284197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:08.285634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:08.295594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 130/262] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:08 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:08.301497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:08.327551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:08.328216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:08.328542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:08.328817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:08.353349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:08.358633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:08.359534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:08.360331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 133/263] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:08.367042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:08.432504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:08.462567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad98d0b-35e4-485c-a693-42933eceff0b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:08.514361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:08.514985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:08.515266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:08.515545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:08.516332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=67c1feefaad44a81b4370d81dc26c5dd) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:08.516642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:08.519829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:08.529769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 131/264] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:08 2022] GET /identity/v3/role_assignments?user.id=67c1feefaad44a81b4370d81dc26c5dd&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:08.605322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1defd95-f81d-4321-8f97-970f7a9e43ce None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:08.655108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15eb25-31f1-45e7-8bb6-936dca0a3cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:08.655751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15eb25-31f1-45e7-8bb6-936dca0a3cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:08.656030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15eb25-31f1-45e7-8bb6-936dca0a3cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:08.656304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15eb25-31f1-45e7-8bb6-936dca0a3cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:08.657040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15eb25-31f1-45e7-8bb6-936dca0a3cf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:08.657346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15eb25-31f1-45e7-8bb6-936dca0a3cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:08.658774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15eb25-31f1-45e7-8bb6-936dca0a3cf1 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:08.671426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:08.677276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:08.831147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5566-ebeb-493e-a926-369d4e63151f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:08.873532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:08.874101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:08.874409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:08.874683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] PATH_INFO: `/v3/users/67c1feefaad44a81b4370d81dc26c5dd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:08.875867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] RBAC: Authorizing `identity:get_user(user_id=67c1feefaad44a81b4370d81dc26c5dd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:08.877310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:08.879268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 132/266] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:08 2022] GET /identity/v3/users/67c1feefaad44a81b4370d81dc26c5dd => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:08.882898 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc1f4b-5041-4d51-bbbc-9a9b6aeb6091 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:08.883189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc1f4b-5041-4d51-bbbc-9a9b6aeb6091 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:08.883465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc1f4b-5041-4d51-bbbc-9a9b6aeb6091 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:08.884809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 135/267] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:08.888475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:08.894078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf229c89-9b6c-4d6d-b82c-35c213823a09 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:08.894393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf229c89-9b6c-4d6d-b82c-35c213823a09 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:08.894667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf229c89-9b6c-4d6d-b82c-35c213823a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:08.921576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bf229c89-9b6c-4d6d-b82c-35c213823a09 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:08.924224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bf229c89-9b6c-4d6d-b82c-35c213823a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:08.924758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:08.952600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.055903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 136/268] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:09.064536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd93fe-e8ed-49f7-9494-87c5ab6249ab None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.091829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf229c89-9b6c-4d6d-b82c-35c213823a09 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.124823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.125369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.125649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.125921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.229028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:09.230617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:09.245762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.255007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf229c89-9b6c-4d6d-b82c-35c213823a09 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.303011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd900-3af3-47e1-9922-ccd68041deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.303661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd900-3af3-47e1-9922-ccd68041deba None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.303940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd900-3af3-47e1-9922-ccd68041deba None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.304210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd900-3af3-47e1-9922-ccd68041deba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.315064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd900-3af3-47e1-9922-ccd68041deba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-6c0fd900-3af3-47e1-9922-ccd68041deba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:09.320918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:09.321818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:09.322646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 137/269] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:09.323764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb933-a0bf-4949-a53b-27ba5f862174 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.325727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb933-a0bf-4949-a53b-27ba5f862174 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.325727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb933-a0bf-4949-a53b-27ba5f862174 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.325727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 138/270] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:09.330980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff0f3-3f1a-45dd-9880-c29e4e459781 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.331264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff0f3-3f1a-45dd-9880-c29e4e459781 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.331536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ff0f3-3f1a-45dd-9880-c29e4e459781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.348321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 133/271] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:09.349300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.350130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bc2ff0f3-3f1a-45dd-9880-c29e4e459781 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:09.351351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bc2ff0f3-3f1a-45dd-9880-c29e4e459781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:09.354632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.430439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 139/272] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:09.431468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ff0f3-3f1a-45dd-9880-c29e4e459781 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.457241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3d47-408d-4ba4-859d-12b121e43085 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.471326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.494573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.495366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.495708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.496062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.497478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:09.498041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:09.499833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:09.509511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 134/273] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:09.514820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.555269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ff0f3-3f1a-45dd-9880-c29e4e459781 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.589672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.590371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.590655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.590925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.592087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:09.593546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:09.595420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 140/274] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:09 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:09.596086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.607438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.624271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803561a8-ffce-4caa-a3e9-1ce9bff96574 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.657913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.658567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.658840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.659113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.660232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:09.662209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:09.663970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 135/275] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:09.664546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.705960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ed40f-a7c9-4f5b-b318-593cff8576d4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.712832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.743158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee810aa-d511-4ddc-84c9-8a74531a679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.744286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee810aa-d511-4ddc-84c9-8a74531a679b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.744767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee810aa-d511-4ddc-84c9-8a74531a679b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.745250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee810aa-d511-4ddc-84c9-8a74531a679b None admin] PATH_INFO: `/v3/users/5a61d4bbb0a04de68973ac07fea64a82` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.759195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee810aa-d511-4ddc-84c9-8a74531a679b None admin] RBAC: Authorizing `identity:get_user(user_id=5a61d4bbb0a04de68973ac07fea64a82)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:09.760956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee810aa-d511-4ddc-84c9-8a74531a679b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:09.763066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 141/276] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:09 2022] GET /identity/v3/users/5a61d4bbb0a04de68973ac07fea64a82 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:09.764318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722a73-ec39-48f3-b482-a5f6e2d00c76 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.764603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722a73-ec39-48f3-b482-a5f6e2d00c76 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.764873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722a73-ec39-48f3-b482-a5f6e2d00c76 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.766277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 142/277] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:09.770799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722a73-ec39-48f3-b482-a5f6e2d00c76 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.778817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536b522-bbbb-4e0c-b23e-6a2e96bbb340 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.816181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.816801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.817081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.817354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.818173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] RBAC: Adding query filter params (role.id=16d20d9321574453897849a9f649b636, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=67c1feefaad44a81b4370d81dc26c5dd) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:09.818508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:09.819955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:09.825695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 136/278] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:09 2022] GET /identity/v3/role_assignments?user.id=67c1feefaad44a81b4370d81dc26c5dd&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=16d20d9321574453897849a9f649b636 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:09.826509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:09.858737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.898565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722a73-ec39-48f3-b482-a5f6e2d00c76 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.941955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e64acb-429e-4d14-bb92-a3a00208edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:09.942692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64acb-429e-4d14-bb92-a3a00208edd6 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.942977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64acb-429e-4d14-bb92-a3a00208edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.943252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64acb-429e-4d14-bb92-a3a00208edd6 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.943952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e64acb-429e-4d14-bb92-a3a00208edd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:09.945454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e64acb-429e-4d14-bb92-a3a00208edd6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:09.955127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652feed-1c13-4f98-ae29-15c18026dab3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:09.964368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:09.969850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 143/279] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:09 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:09.971157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b864564-09cb-4923-8596-a84c80e0ace6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:09.971442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b864564-09cb-4923-8596-a84c80e0ace6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:09.971713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b864564-09cb-4923-8596-a84c80e0ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:09.993268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9b864564-09cb-4923-8596-a84c80e0ace6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:09.994554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9b864564-09cb-4923-8596-a84c80e0ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:10.014035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de32c-6d60-44a3-ac2a-bb26e1c4ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.014482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de32c-6d60-44a3-ac2a-bb26e1c4ca0b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.015079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de32c-6d60-44a3-ac2a-bb26e1c4ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.015079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de32c-6d60-44a3-ac2a-bb26e1c4ca0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.016103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de32c-6d60-44a3-ac2a-bb26e1c4ca0b None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, user.id=5a61d4bbb0a04de68973ac07fea64a82, scope.system=all) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:10.016418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de32c-6d60-44a3-ac2a-bb26e1c4ca0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:10.018145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de32c-6d60-44a3-ac2a-bb26e1c4ca0b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:10.024643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 137/280] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 28 22:02:09 2022] GET /identity/v3/role_assignments?user.id=5a61d4bbb0a04de68973ac07fea64a82&scope.system=all&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:10.025464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4ed9-c829-43cd-baff-1bf258ddfe6d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.026001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4ed9-c829-43cd-baff-1bf258ddfe6d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.030484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4ed9-c829-43cd-baff-1bf258ddfe6d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.032458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 138/281] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:10.039375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7288b-f3d5-47a0-a682-637f6b4ad8d7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.039728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7288b-f3d5-47a0-a682-637f6b4ad8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.039923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7288b-f3d5-47a0-a682-637f6b4ad8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.061920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7aa7288b-f3d5-47a0-a682-637f6b4ad8d7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:10.063295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7aa7288b-f3d5-47a0-a682-637f6b4ad8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:10.086308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 144/282] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:10.115890 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b864564-09cb-4923-8596-a84c80e0ace6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.146464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 139/283] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:10.172111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7288b-f3d5-47a0-a682-637f6b4ad8d7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.190528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:10.252226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b864564-09cb-4923-8596-a84c80e0ace6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:10.294503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.295340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.295448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.295687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.310622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:10.312637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:10.313961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7288b-f3d5-47a0-a682-637f6b4ad8d7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:10.318782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:10.319830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:10.320786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:10.322568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 145/284] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:10.328166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.358755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.359492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.359861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.360570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.375487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:10.382575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:10.383647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:10.384591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 140/285] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:10.390363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.457121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ce25-2370-4774-b84d-6a49410fc870 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:10.471990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:10.496062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.496869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.497155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.497517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.498257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:10.498581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:10.500090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:10.506473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5ee2-5629-4f52-857e-e74e0c21295f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:10.510399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 146/286] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:10.515783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.542378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.542996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.543272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.543637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.544251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:10.544549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:10.545911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:10.555179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 141/287] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:10.560646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.585584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:10.628292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c8c3a-e767-4d9a-b970-7aa5d21abd55 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:10.664676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.665574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.665993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.666463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] PATH_INFO: `/v3/users/cb4a37636df34cee9686034564785837` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.667799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] RBAC: Authorizing `identity:get_user(user_id=cb4a37636df34cee9686034564785837)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:10.669511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:10.677006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 147/288] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/users/cb4a37636df34cee9686034564785837 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:10.682599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.717334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255825a9-235a-4537-b637-e187da56aa9a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:10.768229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:10.786898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.790468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.790858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.791239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] PATH_INFO: `/v3/users/ee524a3bc7ea4f0c94710a6611806b53` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.792562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] RBAC: Authorizing `identity:get_user(user_id=ee524a3bc7ea4f0c94710a6611806b53)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:10.795132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:10.800053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 142/289] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/users/ee524a3bc7ea4f0c94710a6611806b53 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:10.807910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.887718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fab13-e672-4b77-88e2-39fa8bbfbb45 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:10.961351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:10.961992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:10.962293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:10.962569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:10.964722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:10.966181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:10.970652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 148/290] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:10.976251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:10.987752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:11.001950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003431-93f6-4ada-a534-82f70150da4e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:11.075958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:11.076509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:11.076794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:11.077075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:11.091844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bdb10-e7ae-4916-9c21-f43e7655d419 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:11.104119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:11.132923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:11.133765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:11.134052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:11.134677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da/users/cb4a37636df34cee9686034564785837/roles/dfdbf88fc1e14740ba5405837f6bf2fc` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:11.137029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] RBAC: Authorizing `identity:create_grant(project_id=3656add4314844e9b72312ec211f48da, user_id=cb4a37636df34cee9686034564785837, role_id=dfdbf88fc1e14740ba5405837f6bf2fc)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:11.139498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:11.169159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 149/291] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:10 2022] PUT /identity/v3/projects/3656add4314844e9b72312ec211f48da/users/cb4a37636df34cee9686034564785837/roles/dfdbf88fc1e14740ba5405837f6bf2fc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:11.195210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:11.196777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:11.296870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:11.308211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 143/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:11.313802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:11.424698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5b76-b564-4c5a-bbfc-c9f6fa331486 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:11.459995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d50c3c-c8ef-4453-b573-f0e5d473cdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:11.460645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50c3c-c8ef-4453-b573-f0e5d473cdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:11.460921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50c3c-c8ef-4453-b573-f0e5d473cdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:11.461190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50c3c-c8ef-4453-b573-f0e5d473cdf5 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:11.462404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d50c3c-c8ef-4453-b573-f0e5d473cdf5 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:11.463841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d50c3c-c8ef-4453-b573-f0e5d473cdf5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:11.465494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 150/293] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:11 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:11.471451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:11.574435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23842-e227-4834-b74e-0eddfbc778df None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:11.610026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c05a31-4f71-45c8-a082-72c05c0e2f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:11.610770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c05a31-4f71-45c8-a082-72c05c0e2f0e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:11.611083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c05a31-4f71-45c8-a082-72c05c0e2f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:11.611360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c05a31-4f71-45c8-a082-72c05c0e2f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:11.612149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c05a31-4f71-45c8-a082-72c05c0e2f0e None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=ee524a3bc7ea4f0c94710a6611806b53) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:11.612450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c05a31-4f71-45c8-a082-72c05c0e2f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:11.613878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c05a31-4f71-45c8-a082-72c05c0e2f0e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:11.621025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 144/294] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:11 2022] GET /identity/v3/role_assignments?user.id=ee524a3bc7ea4f0c94710a6611806b53&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:12.345271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652c280-887a-4e9c-9fd3-789171b3988d None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.346288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652c280-887a-4e9c-9fd3-789171b3988d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.346798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652c280-887a-4e9c-9fd3-789171b3988d None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.348588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 151/295] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:12.354123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4651-a1d5-488b-a93a-9c13f62e9b99 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.354659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4651-a1d5-488b-a93a-9c13f62e9b99 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.355131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4651-a1d5-488b-a93a-9c13f62e9b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.373643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-201a4651-a1d5-488b-a93a-9c13f62e9b99 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:12.375155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-201a4651-a1d5-488b-a93a-9c13f62e9b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:12.424831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:12.443853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 145/296] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:12.464959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652c280-887a-4e9c-9fd3-789171b3988d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:12.508310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:12.577560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652c280-887a-4e9c-9fd3-789171b3988d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:12.585800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542d42-641a-4f55-afb3-079b046ba4c2 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.586295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542d42-641a-4f55-afb3-079b046ba4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.586485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542d42-641a-4f55-afb3-079b046ba4c2 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.587834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 146/297] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:12.592647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4758-a6c6-4d8b-9761-0cb77d29fb37 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.592927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4758-a6c6-4d8b-9761-0cb77d29fb37 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.593199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4758-a6c6-4d8b-9761-0cb77d29fb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.611685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9a1f4758-a6c6-4d8b-9761-0cb77d29fb37 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:12.613128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9a1f4758-a6c6-4d8b-9761-0cb77d29fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:12.613952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:12.615255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.615534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.616096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.632404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:12.639082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:12.639977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:12.640765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:12.641365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 152/298] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:12.646824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:12.707727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 147/299] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:12.707727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605238d-70b4-4686-876f-4260a7692a9d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.707727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605238d-70b4-4686-876f-4260a7692a9d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.707727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605238d-70b4-4686-876f-4260a7692a9d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.707727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 148/300] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:12.710359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4ab1-5d0c-48c7-8430-5e90a476e5f3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.710645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4ab1-5d0c-48c7-8430-5e90a476e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.710922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4ab1-5d0c-48c7-8430-5e90a476e5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.731577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9c6a4ab1-5d0c-48c7-8430-5e90a476e5f3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:12.732750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9c6a4ab1-5d0c-48c7-8430-5e90a476e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:12.771936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:12.776734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f401-d274-44b8-b6ee-af3676a96fd3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:12.802193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 149/301] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:12.802871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a4ab1-5d0c-48c7-8430-5e90a476e5f3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:12.820759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:12.821451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.822110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.822110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.823145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:12.823557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:12.824816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:12.832885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 153/302] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:12.836129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:12.859637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:12.919261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a4ab1-5d0c-48c7-8430-5e90a476e5f3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:12.948698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d76d-8e2b-440b-9af4-b0762856cb03 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:12.953054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:12.953699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.953975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.954267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.965003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:12.970000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:12.971057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 150/303] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:12.972009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:12.991077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:12.991901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:12.992184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:12.992456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:12.993616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:12.995124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:12.996708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 154/304] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:12.997459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:13.028059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:13.089437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3f251-b7f7-4e19-abb1-bbb77893b02b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:13.091868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:13.107644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0edb63-60c4-496d-9d89-01f4af53c808 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:13.126444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:13.127091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.127369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.127639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] PATH_INFO: `/v3/users/5a61d4bbb0a04de68973ac07fea64a82` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.129061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] RBAC: Authorizing `identity:get_user(user_id=5a61d4bbb0a04de68973ac07fea64a82)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:13.131161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:13.137611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 151/305] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:12 2022] GET /identity/v3/users/5a61d4bbb0a04de68973ac07fea64a82 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:13.137611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:13.154079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:13.154753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.155031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.155306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.156026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:13.156332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:13.157726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:13.170470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 155/306] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:13.170470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:13.250157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f5523-9a15-4762-bfce-04ed22df4990 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:13.265674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:13.276363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d402-284f-4a68-a2c2-36675aad79e5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:13.286787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:13.287409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.287688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.287962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] PATH_INFO: `/v3/groups` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.288624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:13.290043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:13.307365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 152/307] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jul 28 22:02:13 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:13.308169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:13.324415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:13.325544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.326043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.326610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] PATH_INFO: `/v3/system/users/5a61d4bbb0a04de68973ac07fea64a82/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.328634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5a61d4bbb0a04de68973ac07fea64a82, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:13.330626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:13.342810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 156/308] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jul 28 22:02:13 2022] PUT /identity/v3/system/users/5a61d4bbb0a04de68973ac07fea64a82/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:13.359425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:13.449058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd88b0-261e-4ec6-818c-5e6ad3427143 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:13.495317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd72b8f-af89-4a2b-9c3a-0dda44fb1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:13.496470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72b8f-af89-4a2b-9c3a-0dda44fb1791 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.496949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72b8f-af89-4a2b-9c3a-0dda44fb1791 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.497418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72b8f-af89-4a2b-9c3a-0dda44fb1791 None admin] PATH_INFO: `/v3/users/5451bb9b64c54c1697498645ae578649` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.513507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd72b8f-af89-4a2b-9c3a-0dda44fb1791 None admin] RBAC: Authorizing `identity:get_user(user_id=5451bb9b64c54c1697498645ae578649)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:13.515336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd72b8f-af89-4a2b-9c3a-0dda44fb1791 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:13.517390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 153/309] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:13 2022] GET /identity/v3/users/5451bb9b64c54c1697498645ae578649 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:13.523564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:13.532941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4a4aa-cbb4-4afb-b8aa-7b8c05af9e74 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.534131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4a4aa-cbb4-4afb-b8aa-7b8c05af9e74 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.534636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4a4aa-cbb4-4afb-b8aa-7b8c05af9e74 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.537168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 154/310] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:13.542982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b0f0a-2db7-4816-a9ac-01e645088eae None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.543257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b0f0a-2db7-4816-a9ac-01e645088eae None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.543534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b0f0a-2db7-4816-a9ac-01e645088eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.563562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d66b0f0a-2db7-4816-a9ac-01e645088eae None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:13.564928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d66b0f0a-2db7-4816-a9ac-01e645088eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:13.640969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e633-28fa-4bd6-82b8-06683252eb40 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:13.643363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 155/311] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:13.668568 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b0f0a-2db7-4816-a9ac-01e645088eae None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:13.683793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:13.684707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.685179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.685641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.687003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] RBAC: Adding query filter params (role.id=dfdbf88fc1e14740ba5405837f6bf2fc, user.id=5451bb9b64c54c1697498645ae578649, scope.system=all) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:13.687516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:13.689140 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:13.694148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:13.695920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 157/312] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 28 22:02:13 2022] GET /identity/v3/role_assignments?user.id=5451bb9b64c54c1697498645ae578649&scope.system=all&role.id=dfdbf88fc1e14740ba5405837f6bf2fc => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:13.797722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b0f0a-2db7-4816-a9ac-01e645088eae None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:13.837495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:13.838157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:13.838461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:13.838736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:13.851211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:13.856357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:13.857235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:13.858033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 156/313] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:13.864845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:13.887887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:13.976650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854be86-b8ea-4a77-8196-5cabe3ba7fca None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:14.013286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:14.014276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:14.014826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:14.015290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:14.016253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:14.016751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:14.018421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:14.027994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 158/314] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:14.034295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:14.119373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:14.141446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2f692-c657-4689-9fa4-1105d2cf4e55 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:14.178005 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:14.178677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:14.178957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:14.179229 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] PATH_INFO: `/v3/users/cb4a37636df34cee9686034564785837` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:14.180419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] RBAC: Authorizing `identity:get_user(user_id=cb4a37636df34cee9686034564785837)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:14.182186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:14.184105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 157/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:14 2022] GET /identity/v3/users/cb4a37636df34cee9686034564785837 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:14.189624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:14.276825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:14.296361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4701479-7707-4c18-bb16-f62f1da76ecc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:14.330308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:14.330935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:14.331215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:14.331486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:14.401229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:14.402624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:14.486652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:14.509600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 159/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:14.510530 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:14.625932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f2f8-681a-45ad-8ad1-0e7462f3ddfc None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:14.661902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7311a7-885a-46b9-a3ea-6bcde551dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:14.662520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7311a7-885a-46b9-a3ea-6bcde551dadb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:14.662751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7311a7-885a-46b9-a3ea-6bcde551dadb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:14.663022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7311a7-885a-46b9-a3ea-6bcde551dadb None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:14.664183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7311a7-885a-46b9-a3ea-6bcde551dadb None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:14.665637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7311a7-885a-46b9-a3ea-6bcde551dadb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:14.667622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 158/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:14 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:14.673378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:14.787294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc51e-1488-492b-b123-ced3c4adb71d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:14.825663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1e26-cf89-4a37-bfc4-74ab79570df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:14.826315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1e26-cf89-4a37-bfc4-74ab79570df7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:14.826599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1e26-cf89-4a37-bfc4-74ab79570df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:14.826869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1e26-cf89-4a37-bfc4-74ab79570df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:14.827659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1e26-cf89-4a37-bfc4-74ab79570df7 None admin] RBAC: Adding query filter params (role.id=dfdbf88fc1e14740ba5405837f6bf2fc, scope.project.id=3656add4314844e9b72312ec211f48da, user.id=cb4a37636df34cee9686034564785837) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:14.827966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1e26-cf89-4a37-bfc4-74ab79570df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:14.829408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1e26-cf89-4a37-bfc4-74ab79570df7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:14.835720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 160/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:14 2022] GET /identity/v3/role_assignments?user.id=cb4a37636df34cee9686034564785837&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=dfdbf88fc1e14740ba5405837f6bf2fc => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:15.432732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eead27b-1933-4835-b7c5-a5803a075659 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.432943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eead27b-1933-4835-b7c5-a5803a075659 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.433228 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eead27b-1933-4835-b7c5-a5803a075659 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.434743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 159/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:15.439782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb662b-706d-4e5c-aea5-dc9da278db3d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.440076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb662b-706d-4e5c-aea5-dc9da278db3d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.440356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb662b-706d-4e5c-aea5-dc9da278db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.458747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d8fb662b-706d-4e5c-aea5-dc9da278db3d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:15.459960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d8fb662b-706d-4e5c-aea5-dc9da278db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:15.499308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:15.513746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be72e9-f8b5-4259-ad5a-7879f01e6719 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.514015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be72e9-f8b5-4259-ad5a-7879f01e6719 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.514316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be72e9-f8b5-4259-ad5a-7879f01e6719 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.515790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 160/320] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:15.520294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c586-c0df-4195-af86-13e01bda8661 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.521118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c586-c0df-4195-af86-13e01bda8661 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.521387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c586-c0df-4195-af86-13e01bda8661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.529454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 161/321] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:15.539481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3c59c586-c0df-4195-af86-13e01bda8661 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:15.540650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3c59c586-c0df-4195-af86-13e01bda8661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:15.551344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:15.551644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb662b-706d-4e5c-aea5-dc9da278db3d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:15.610456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 161/322] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:15.633638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c586-c0df-4195-af86-13e01bda8661 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:15.655905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb662b-706d-4e5c-aea5-dc9da278db3d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:15.693944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721b155-50a7-4e4e-a646-55256f8d0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:15.695377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721b155-50a7-4e4e-a646-55256f8d0ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.695729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721b155-50a7-4e4e-a646-55256f8d0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.696065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721b155-50a7-4e4e-a646-55256f8d0ef9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.697383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721b155-50a7-4e4e-a646-55256f8d0ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:15.698959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721b155-50a7-4e4e-a646-55256f8d0ef9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:15.700537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 162/323] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:15.701696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71542c31-6cda-4716-b9be-04372e61be17 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.702001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71542c31-6cda-4716-b9be-04372e61be17 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.702287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71542c31-6cda-4716-b9be-04372e61be17 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.703474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 163/324] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:15.705713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71542c31-6cda-4716-b9be-04372e61be17 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:15.738569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c586-c0df-4195-af86-13e01bda8661 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:15.748388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:15.774296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981120a3-d5af-4394-8795-b2b98a1e8502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:15.774991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981120a3-d5af-4394-8795-b2b98a1e8502 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.775268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981120a3-d5af-4394-8795-b2b98a1e8502 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.775538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981120a3-d5af-4394-8795-b2b98a1e8502 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.785559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981120a3-d5af-4394-8795-b2b98a1e8502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-981120a3-d5af-4394-8795-b2b98a1e8502 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:15.790561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:15.797515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 162/325] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:15.798393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351fc7-81f1-4e90-baa6-b8c261ffe781 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.799116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351fc7-81f1-4e90-baa6-b8c261ffe781 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.799116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351fc7-81f1-4e90-baa6-b8c261ffe781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.808023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:15.809863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71542c31-6cda-4716-b9be-04372e61be17 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:15.813522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ed351fc7-81f1-4e90-baa6-b8c261ffe781 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:15.814725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ed351fc7-81f1-4e90-baa6-b8c261ffe781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:15.843907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:15.844518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:15.844794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:15.845062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] PATH_INFO: `/v3/groups` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:15.845722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:15.847222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:15.862411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 164/326] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jul 28 22:02:15 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:02:15.863425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:15.887776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 163/327] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:15.910353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351fc7-81f1-4e90-baa6-b8c261ffe781 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:15.979089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519153c-f971-4d75-a64e-033a9b45684a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:15.980722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:16.026384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351fc7-81f1-4e90-baa6-b8c261ffe781 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:16.029426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:16.030067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:16.031371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:16.031371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:16.031371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] RBAC: Adding query filter params (name=member) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:16.031708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:16.033051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:16.042478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 165/328] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:16.048038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:16.064496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:16.065411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:16.065685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:16.065948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:16.069626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:16.079500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:16.084532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:16.090668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 164/329] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:16.091491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:16.187616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefbfb2-b02d-42ee-bd59-4099a3ba7dcf None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:16.216038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9313-e530-4957-8a3e-075cdc01294e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:16.229445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:16.230482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:16.231016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:16.231293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] PATH_INFO: `/v3/users/5a61d4bbb0a04de68973ac07fea64a82` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:16.232879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] RBAC: Authorizing `identity:get_user(user_id=5a61d4bbb0a04de68973ac07fea64a82)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:16.233950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:16.236221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 166/330] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:16 2022] GET /identity/v3/users/5a61d4bbb0a04de68973ac07fea64a82 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:16.242342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:16.257076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:16.258012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:16.258478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:16.258746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:16.259459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:16.259841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:16.261142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:16.271954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 165/331] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:16.278042 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:16.279418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:16.376304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fb5aa-6003-441f-b700-ea09c95cfc0c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:16.401696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:16.409445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffbf8-2b20-4796-abed-9636b24e84db None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:16.435961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:16.436954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:16.437527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:16.437995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:16.439070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] RBAC: Adding query filter params (role.id=a56d5bfed1f74acdaacf5ccafad8ec18, user.id=5a61d4bbb0a04de68973ac07fea64a82, scope.system=all) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:16.439605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:16.441488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:16.453476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db9896-b81b-45a8-9f27-c156f0d8a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:16.454547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db9896-b81b-45a8-9f27-c156f0d8a9ab None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:16.454810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db9896-b81b-45a8-9f27-c156f0d8a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:16.455102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db9896-b81b-45a8-9f27-c156f0d8a9ab None admin] PATH_INFO: `/v3/users/5451bb9b64c54c1697498645ae578649` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:16.456278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db9896-b81b-45a8-9f27-c156f0d8a9ab None admin] RBAC: Authorizing `identity:get_user(user_id=5451bb9b64c54c1697498645ae578649)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:16.457715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db9896-b81b-45a8-9f27-c156f0d8a9ab None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:16.458097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 167/332] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 28 22:02:16 2022] GET /identity/v3/role_assignments?user.id=5a61d4bbb0a04de68973ac07fea64a82&scope.system=all&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:16.459445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 166/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:16 2022] GET /identity/v3/users/5451bb9b64c54c1697498645ae578649 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:16.465340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:16.570694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:16.584102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f847-7e19-473a-b882-213a0ab709b7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:16.625140 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0a293-1a15-4aae-a277-150b5fd34dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:16.625596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0a293-1a15-4aae-a277-150b5fd34dda None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:16.625941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0a293-1a15-4aae-a277-150b5fd34dda None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:16.626220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0a293-1a15-4aae-a277-150b5fd34dda None admin] PATH_INFO: `/v3/system/users/5451bb9b64c54c1697498645ae578649/roles/dfdbf88fc1e14740ba5405837f6bf2fc` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:16.627749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0a293-1a15-4aae-a277-150b5fd34dda None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5451bb9b64c54c1697498645ae578649, role_id=dfdbf88fc1e14740ba5405837f6bf2fc)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:16.629411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0a293-1a15-4aae-a277-150b5fd34dda None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:16.638510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 168/334] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jul 28 22:02:16 2022] PUT /identity/v3/system/users/5451bb9b64c54c1697498645ae578649/roles/dfdbf88fc1e14740ba5405837f6bf2fc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:02:18.086316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b4df-f2f7-4afa-bb4d-e70536626580 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:18.087303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b4df-f2f7-4afa-bb4d-e70536626580 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:18.087777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b4df-f2f7-4afa-bb4d-e70536626580 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:18.089319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 167/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:18.095681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe822d-c4be-42ba-8fee-878b84e234ce None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:18.096108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe822d-c4be-42ba-8fee-878b84e234ce None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:18.096281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe822d-c4be-42ba-8fee-878b84e234ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:18.122500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-5dfe822d-c4be-42ba-8fee-878b84e234ce None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:18.123737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5dfe822d-c4be-42ba-8fee-878b84e234ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:18.203676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 169/336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:18.227549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b4df-f2f7-4afa-bb4d-e70536626580 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:18.361930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b4df-f2f7-4afa-bb4d-e70536626580 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:18.389091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:18.402832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b22009-612f-431e-b276-560962cc7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:18.403481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b22009-612f-431e-b276-560962cc7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:18.403759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b22009-612f-431e-b276-560962cc7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:18.404030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b22009-612f-431e-b276-560962cc7bc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:18.419786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b22009-612f-431e-b276-560962cc7bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f6b22009-612f-431e-b276-560962cc7bc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:18.425204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:18.426303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:18.427330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 168/337] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:18.433809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe822d-c4be-42ba-8fee-878b84e234ce None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:18.592160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:18.595762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e6def-9020-4a54-9dbb-98a65f3e8dee None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:18.596049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e6def-9020-4a54-9dbb-98a65f3e8dee None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:18.596486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e6def-9020-4a54-9dbb-98a65f3e8dee None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:18.597834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 169/338] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:18.607640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1e40c-d961-416c-93df-82873d29e5a8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:18.607913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1e40c-d961-416c-93df-82873d29e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:18.608187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1e40c-d961-416c-93df-82873d29e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:18.613522 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe822d-c4be-42ba-8fee-878b84e234ce None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:18.646815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-37d1e40c-d961-416c-93df-82873d29e5a8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:18.648026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-37d1e40c-d961-416c-93df-82873d29e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:18.666555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:18.667202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:18.667485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:18.667763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:18.668494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:18.668801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:18.670196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:18.687513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 170/339] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:18.693830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:18.807189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 170/340] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:18.824040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721a0ef-84ce-4684-a875-0cb19aa1c2fc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:18.848171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1e40c-d961-416c-93df-82873d29e5a8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:18.865880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a189b-888d-45a4-8909-a76944ae63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:18.866463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a189b-888d-45a4-8909-a76944ae63a2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:18.866863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a189b-888d-45a4-8909-a76944ae63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:18.867140 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a189b-888d-45a4-8909-a76944ae63a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:18.886637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:18.989095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a189b-888d-45a4-8909-a76944ae63a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:18.990603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a189b-888d-45a4-8909-a76944ae63a2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:19.024129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1e40c-d961-416c-93df-82873d29e5a8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.045203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:19.076300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.077289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.080897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.082049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.094979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:19.101633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:19.102725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:19.103532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:19.106092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 171/341] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:19.112961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:19.184943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 171/342] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 22:02:19.186270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32034434-dbd7-49d2-9124-b51d37d3d250 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.186702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32034434-dbd7-49d2-9124-b51d37d3d250 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.186963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32034434-dbd7-49d2-9124-b51d37d3d250 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.188565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 172/343] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:19.194365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32034434-dbd7-49d2-9124-b51d37d3d250 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:19.269280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:19.272605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06771-98b6-4c6e-9bb6-2bae137b2c1b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.310018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9df4f-6393-4a04-ae13-dc6159547fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.311009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9df4f-6393-4a04-ae13-dc6159547fbe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.311434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9df4f-6393-4a04-ae13-dc6159547fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.311843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9df4f-6393-4a04-ae13-dc6159547fbe None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.312717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9df4f-6393-4a04-ae13-dc6159547fbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:19.313157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9df4f-6393-4a04-ae13-dc6159547fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:19.314689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9df4f-6393-4a04-ae13-dc6159547fbe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:19.325111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 172/344] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:19.329336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9111c-fcbe-451d-b17d-9262c8b8a0a8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.329899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9111c-fcbe-451d-b17d-9262c8b8a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.330374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9111c-fcbe-451d-b17d-9262c8b8a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.353010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f9d9111c-fcbe-451d-b17d-9262c8b8a0a8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:19.354731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f9d9111c-fcbe-451d-b17d-9262c8b8a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:19.379358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32034434-dbd7-49d2-9124-b51d37d3d250 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.389719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:19.427986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.428646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.429075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.429362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.430674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:19.432196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:19.434258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 173/345] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:19.434888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:19.439980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 173/346] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:19.443903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9111c-fcbe-451d-b17d-9262c8b8a0a8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:19.555633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d379-730b-48a9-82c3-dbe590771c07 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.570724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9111c-fcbe-451d-b17d-9262c8b8a0a8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.571016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:19.594290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28332804-7827-468d-813a-78e34f4beb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.595217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332804-7827-468d-813a-78e34f4beb24 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.595349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332804-7827-468d-813a-78e34f4beb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.595552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332804-7827-468d-813a-78e34f4beb24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.610369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.611330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.611801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.612287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.620372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:19.622073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:19.624230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 174/347] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:19.625183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:19.664366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:19.673837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28332804-7827-468d-813a-78e34f4beb24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:19.676217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28332804-7827-468d-813a-78e34f4beb24 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:19.738426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295653ca-3697-469d-8308-59e4cfe30683 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.776117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.777130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.777602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.778065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.789659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:19.790826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 174/348] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:19.791935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bdd1b-d264-4d48-b21d-e4f3a1704a63 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.792220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bdd1b-d264-4d48-b21d-e4f3a1704a63 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.792490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bdd1b-d264-4d48-b21d-e4f3a1704a63 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.797053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 175/349] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:19.797053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bdd1b-d264-4d48-b21d-e4f3a1704a63 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:19.802698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:19.803608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:19.804425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:19.807016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 175/350] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:19.808056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:19.812702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:19.905087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:19.914571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bdd1b-d264-4d48-b21d-e4f3a1704a63 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.915798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cb2af-5c53-4868-bd86-f93bf91d11aa None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:19.952872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e4516-6fac-4186-bbb6-bf488e1bf89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.953655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4516-6fac-4186-bbb6-bf488e1bf89d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.954032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4516-6fac-4186-bbb6-bf488e1bf89d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.956332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4516-6fac-4186-bbb6-bf488e1bf89d None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.957096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:19.957652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e4516-6fac-4186-bbb6-bf488e1bf89d None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:19.958593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.959013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.959423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.960023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e4516-6fac-4186-bbb6-bf488e1bf89d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:19.960507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:19.960976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:19.962281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 176/351] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:19.962788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:19.967538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8b22e-fabf-4a9e-acab-9442c50b5287 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:19.967819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8b22e-fabf-4a9e-acab-9442c50b5287 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:19.968087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8b22e-fabf-4a9e-acab-9442c50b5287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:19.969725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 176/352] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:19.970725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.007339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8dd8b22e-fabf-4a9e-acab-9442c50b5287 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:20.008523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8dd8b22e-fabf-4a9e-acab-9442c50b5287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:20.063909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:20.090901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 177/353] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:20.091929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8b22e-fabf-4a9e-acab-9442c50b5287 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.095754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214cd3-5def-4079-9dec-69bbd133af38 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.135746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:20.136962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.137534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.138101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.139062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:20.139565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:20.141582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:20.153053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 177/354] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:20.154288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.198328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:20.208913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8b22e-fabf-4a9e-acab-9442c50b5287 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.251051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:20.251701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.251984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.252261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.253775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:20.256368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:20.257403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 178/355] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:20.258171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.275642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454b968-e895-4470-aab6-e2b9fbc3da1e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.314539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:20.315196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.315477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.315748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.324533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:20.327838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:20.335345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:20.336261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:20.337298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 178/356] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:20.337956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.374799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31d96f-bd32-4b65-9e56-91d935f1be24 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.412655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25925fa1-d717-40d5-91c9-38c634f3aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:20.413367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925fa1-d717-40d5-91c9-38c634f3aacc None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.413645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925fa1-d717-40d5-91c9-38c634f3aacc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.414008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925fa1-d717-40d5-91c9-38c634f3aacc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.443563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:20.459162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4258-d36e-4039-a718-811288873c8a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.490154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25925fa1-d717-40d5-91c9-38c634f3aacc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:20.491732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25925fa1-d717-40d5-91c9-38c634f3aacc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:20.497448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:20.498078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.498405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.498678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.499470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=16d20d9321574453897849a9f649b636, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:20.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:20.501326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:20.508537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 179/357] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=16d20d9321574453897849a9f649b636 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:20.509107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.624024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:20.650845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 179/358] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:20.652301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5d5aa-ea74-46d7-8155-7d7104ee0dd8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.652586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5d5aa-ea74-46d7-8155-7d7104ee0dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.652856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5d5aa-ea74-46d7-8155-7d7104ee0dd8 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.654569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 180/359] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:20.664665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6457-af3b-43f5-bb90-7526f81c6054 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.664987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6457-af3b-43f5-bb90-7526f81c6054 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.665206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6457-af3b-43f5-bb90-7526f81c6054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.693945 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4aaa6457-af3b-43f5-bb90-7526f81c6054 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:20.695230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4aaa6457-af3b-43f5-bb90-7526f81c6054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:20.711411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2baffb-8de8-4ffd-ba26-801e93cba8b4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.776159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:20.777162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.777723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.778200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.779171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:20.781080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:20.782793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:20.797803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 180/360] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:20.798703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.806745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:20.819334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 181/361] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:20.820543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa6457-af3b-43f5-bb90-7526f81c6054 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:20.928502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa6457-af3b-43f5-bb90-7526f81c6054 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.964279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff010e-cdaa-4fe5-b20c-7589bf2c6d6b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:20.966322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:20.967195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:20.967664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:20.968145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] PATH_INFO: `/v3/users/5451bb9b64c54c1697498645ae578649` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:20.969527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] RBAC: Authorizing `identity:get_user(user_id=5451bb9b64c54c1697498645ae578649)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:20.971186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:20.973023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 182/362] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/users/5451bb9b64c54c1697498645ae578649 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:20.974019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.006337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.021415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.022080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.022358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.022626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.023841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:21.025530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:21.031771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 181/363] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:21.032651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.035740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.081946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4df4a1-30d0-4fd0-ac46-708817ca582f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:21.119763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.120756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.121231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.121689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.133810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:21.139774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:21.140640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:21.141457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:21.144097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 183/364] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:21.146059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.220350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfd6f1-f6ff-485a-b91c-bb783fecab06 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:21.264912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9abdd0-5d1c-4b40-b57e-0dd74609c105 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:21.267160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.267736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.268017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.268289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.269473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] RBAC: Adding query filter params (role.id=dfdbf88fc1e14740ba5405837f6bf2fc, user.id=5451bb9b64c54c1697498645ae578649, scope.system=all) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:21.269473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:21.271544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:21.286790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 182/365] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/role_assignments?user.id=5451bb9b64c54c1697498645ae578649&scope.system=all&role.id=dfdbf88fc1e14740ba5405837f6bf2fc => generated 510 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:21.287374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.294261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.324754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.325771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.326289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.326751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.329439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:21.331189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:21.333051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 184/366] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:21.339113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.352294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.418061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69db8b-ea77-46a3-afba-61291856f086 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:21.458038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd54788-4739-4e54-984f-2fa21f696e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.460831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54788-4739-4e54-984f-2fa21f696e06 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.460831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54788-4739-4e54-984f-2fa21f696e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.460831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd54788-4739-4e54-984f-2fa21f696e06 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.460831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54788-4739-4e54-984f-2fa21f696e06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:21.460831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54788-4739-4e54-984f-2fa21f696e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:21.461675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd54788-4739-4e54-984f-2fa21f696e06 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:21.464423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482bd4-c94e-4793-8e70-04b063f1b856 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:21.471794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 183/367] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:21.472859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34b64-d2e5-426a-add8-e355af5412dc None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.473146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34b64-d2e5-426a-add8-e355af5412dc None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.473460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34b64-d2e5-426a-add8-e355af5412dc None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.478429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 184/368] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:21.481725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34b64-d2e5-426a-add8-e355af5412dc None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.509049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a33fb6-3ea0-4e70-814e-1650deac3518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.510036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33fb6-3ea0-4e70-814e-1650deac3518 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.510534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33fb6-3ea0-4e70-814e-1650deac3518 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.511000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a33fb6-3ea0-4e70-814e-1650deac3518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.512013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a33fb6-3ea0-4e70-814e-1650deac3518 None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=3656add4314844e9b72312ec211f48da) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:21.512520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a33fb6-3ea0-4e70-814e-1650deac3518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:21.514176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a33fb6-3ea0-4e70-814e-1650deac3518 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:21.520849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 185/369] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:21.524862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429773-d0d4-4fc7-865f-08fb0923df84 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.525541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429773-d0d4-4fc7-865f-08fb0923df84 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.526010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429773-d0d4-4fc7-865f-08fb0923df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.545894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e4429773-d0d4-4fc7-865f-08fb0923df84 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:21.547503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e4429773-d0d4-4fc7-865f-08fb0923df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:21.600984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.608124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34b64-d2e5-426a-add8-e355af5412dc None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:21.624672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.630952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 186/370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:21.650164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.650834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.651110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.651380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.669427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429773-d0d4-4fc7-865f-08fb0923df84 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.730174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:21.731611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:21.820851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429773-d0d4-4fc7-865f-08fb0923df84 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:21.843990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 185/371] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:21.849635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.869500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.874509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:21.875436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:21.875942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:21.876409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:21.888838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:21.895527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:21.896485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:21.897280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:21.899894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 187/372] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:21.905544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:21.956320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:21.982555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b634703-b698-4a0f-ae40-f8ced9a2bc37 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.024406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a2516-b110-4a82-8a5b-fca3e3f74912 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.061419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.062535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.063013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.063480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.064384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:22.064877 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.065699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.066395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.066679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.066952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.067367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.068238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.069736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.072273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 186/373] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:22.081454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 188/374] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:22.081833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:22.090704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:22.199330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:22.203095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64d9c-ccb5-4784-9a51-cb451cb5291b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.241019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.241560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.241837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.242106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.318622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:22.330704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.330704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.347114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070187c-7167-4cd4-bafd-8516f66ae3a0 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.408300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.409317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.409799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.410321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.414920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.416583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.419411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 187/375] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:22 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:22.424122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:22.431802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:22.440507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 189/376] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:22.441843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:22.551351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843efebf-abde-4045-a759-ba05fa01c954 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.587756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.588398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.588720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.588989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] PATH_INFO: `/v3/projects/8855a1173a1b45fb8e20b8571862d2ed` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.590146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=8855a1173a1b45fb8e20b8571862d2ed)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.591624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.593563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 190/377] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:22 2022] GET /identity/v3/projects/8855a1173a1b45fb8e20b8571862d2ed => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:22.598952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:22.629294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cdf03-4aab-4e76-ad13-ed8441663b02 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.676805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:22.713739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.714408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.714695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.714969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.715769 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=16d20d9321574453897849a9f649b636, scope.project.id=3656add4314844e9b72312ec211f48da) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:22.716080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.717029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb71571-2e25-4e02-b99b-2f39f49ac9a8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.717520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.728966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 188/378] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:22 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=16d20d9321574453897849a9f649b636 => generated 260 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:22.756202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2634d6-e3ee-4df0-9b26-638c8cb5c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.756860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2634d6-e3ee-4df0-9b26-638c8cb5c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.757136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2634d6-e3ee-4df0-9b26-638c8cb5c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.757406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2634d6-e3ee-4df0-9b26-638c8cb5c1d3 None admin] PATH_INFO: `/v3/groups/570b786c3021478bab9158079ad2185e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.763493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2634d6-e3ee-4df0-9b26-638c8cb5c1d3 None admin] RBAC: Authorizing `identity:get_group(group_id=570b786c3021478bab9158079ad2185e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.765193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2634d6-e3ee-4df0-9b26-638c8cb5c1d3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.767304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 191/379] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:22 2022] GET /identity/v3/groups/570b786c3021478bab9158079ad2185e => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:22.775710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:22.811868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:22.919718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded0fe0-0f61-46d1-b0bc-d155a2814805 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:22.931739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd897f4-c5a9-41d0-821a-ac0ebc22fcd6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.932034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd897f4-c5a9-41d0-821a-ac0ebc22fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.932285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd897f4-c5a9-41d0-821a-ac0ebc22fcd6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.933781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 192/380] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:22.946678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e959-1d54-4e76-b2f1-b0040e48f899 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.946887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e959-1d54-4e76-b2f1-b0040e48f899 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.947111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e959-1d54-4e76-b2f1-b0040e48f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.977053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7cc6e959-1d54-4e76-b2f1-b0040e48f899 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:22.978123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:22.978306 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7cc6e959-1d54-4e76-b2f1-b0040e48f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:22.979148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:22.979583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:22.980005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:22.980958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] RBAC: Adding query filter params (group.id=570b786c3021478bab9158079ad2185e, role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=8855a1173a1b45fb8e20b8571862d2ed) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:22.981596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:22.983276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:22.991022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 189/381] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:22 2022] GET /identity/v3/role_assignments?group.id=570b786c3021478bab9158079ad2185e&scope.project.id=8855a1173a1b45fb8e20b8571862d2ed&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:23.057013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 193/382] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:23.082442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:23.204269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:23.231000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026209-1d4b-4fbf-a533-077e4426a75e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:23.267528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:23.268172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:23.268448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:23.268721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:23.279091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:23.284535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:23.285486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:23.287952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 190/383] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:23.292554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e959-1d54-4e76-b2f1-b0040e48f899 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:23.368262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:23.415125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e959-1d54-4e76-b2f1-b0040e48f899 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:23.463684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:23.464373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:23.464655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:23.464923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:23.465637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:23.465941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:23.467343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:23.480906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 194/384] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:23.486552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:23.606200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d828b-b257-4ee2-937a-11af6d50ac37 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:23.647657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad200-bf82-4cc3-a538-e71b2d59c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:23.648297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad200-bf82-4cc3-a538-e71b2d59c288 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:23.648579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad200-bf82-4cc3-a538-e71b2d59c288 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:23.648851 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad200-bf82-4cc3-a538-e71b2d59c288 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:23.650020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad200-bf82-4cc3-a538-e71b2d59c288 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:23.651494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad200-bf82-4cc3-a538-e71b2d59c288 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:23.653086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 191/385] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:23 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:23.658772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:23.747741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8583036-5f6b-4788-b9dd-0ba752437afb None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:23.748077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8583036-5f6b-4788-b9dd-0ba752437afb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:23.748275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8583036-5f6b-4788-b9dd-0ba752437afb None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:23.750966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 192/386] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:23.757414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ed9ab-643f-4db3-9054-3b8396d9b8a6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:23.757706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ed9ab-643f-4db3-9054-3b8396d9b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:23.757946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ed9ab-643f-4db3-9054-3b8396d9b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:23.782852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:23.792882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-179ed9ab-643f-4db3-9054-3b8396d9b8a6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:23.794137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-179ed9ab-643f-4db3-9054-3b8396d9b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:23.799154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c97a97-39b0-40d4-9732-61ecea131ea3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:23.838304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:23.861873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:23.862549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:23.862826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:23.863092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:23.867413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:23.869222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:23.871565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 195/387] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:23 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:23.877759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:23.924655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 193/388] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:23.950830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ed9ab-643f-4db3-9054-3b8396d9b8a6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.059929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830b9c2-1414-4306-ac66-642310c497c8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.105858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.106941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.107593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.108071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/groups/502add54a1944dc0aee480e13948de84/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.110251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c43f8201b34f6a8c1765c89e41545c, group_id=502add54a1944dc0aee480e13948de84, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:24.111882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:24.141200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 196/389] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 28 22:02:23 2022] PUT /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/groups/502add54a1944dc0aee480e13948de84/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:24.141328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ed9ab-643f-4db3-9054-3b8396d9b8a6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.183395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9266319-81d0-48b1-9403-4f278185f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.183978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9266319-81d0-48b1-9403-4f278185f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.184253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9266319-81d0-48b1-9403-4f278185f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.184521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9266319-81d0-48b1-9403-4f278185f8e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.196426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9266319-81d0-48b1-9403-4f278185f8e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:24.202181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d9266319-81d0-48b1-9403-4f278185f8e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:24.203648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:24.204542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:24.205801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 194/390] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:24.211489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.255474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a1120-b028-48be-aa54-a74dc74b8c75 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.257113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a1120-b028-48be-aa54-a74dc74b8c75 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.257589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a1120-b028-48be-aa54-a74dc74b8c75 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.259593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 195/391] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:24.268384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7b101-f2bb-4cb6-9409-4ca43237751e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.268739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7b101-f2bb-4cb6-9409-4ca43237751e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.268931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7b101-f2bb-4cb6-9409-4ca43237751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.296597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:24.306902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c5d7b101-f2bb-4cb6-9409-4ca43237751e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:24.309091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c5d7b101-f2bb-4cb6-9409-4ca43237751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:24.389364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ab281-1a25-466f-a6ee-a39193c4b013 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.427791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.428417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.428612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 196/392] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:24.428741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.428951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.429670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:24.429976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:24.432846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:24.440521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 197/393] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:24.446173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7b101-f2bb-4cb6-9409-4ca43237751e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.461874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.583797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7b101-f2bb-4cb6-9409-4ca43237751e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.602681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25508442-92ab-4bbf-8ee6-3f3092a00da8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.617959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:24.620859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:24.636806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.637969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.638779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.639533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.640930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:24.642624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:24.644230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.644874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.645295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.645479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.645747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:24 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:24.650644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.667290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:24.673205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:24.674109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:24.678968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 198/395] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:24.698276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.780474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2b4f-1399-4669-9ad9-120a13192ed1 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.821552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.822780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.823285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.823766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.825236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:24.827284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:24.829537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:24 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:24.835028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.909001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:24.929932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534553f-d180-40e4-a7bf-80c6130961d3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.953641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a80fb9-6a0b-4843-b5db-e01c28773822 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:24.974513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.975140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.975417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.975688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.976502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:24.976811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:24.978195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:24.990164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 199/397] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:24.992020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:24.992701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:24.992981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:24.993257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/groups/502add54a1944dc0aee480e13948de84/roles/16d20d9321574453897849a9f649b636` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:24.995538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c43f8201b34f6a8c1765c89e41545c, group_id=502add54a1944dc0aee480e13948de84, role_id=16d20d9321574453897849a9f649b636)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:24.996661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:24.996998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:25.014887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 199/398] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 28 22:02:24 2022] PUT /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c/groups/502add54a1944dc0aee480e13948de84/roles/16d20d9321574453897849a9f649b636 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:25.067264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:25.162907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996f3f1-1d05-4faa-8c7b-89013d4a5678 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:25.200094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bef229-ff88-4bf4-9422-47ffafc504c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:25.200744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bef229-ff88-4bf4-9422-47ffafc504c7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.201019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bef229-ff88-4bf4-9422-47ffafc504c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.201295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bef229-ff88-4bf4-9422-47ffafc504c7 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.202499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bef229-ff88-4bf4-9422-47ffafc504c7 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:25.203988 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bef229-ff88-4bf4-9422-47ffafc504c7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:25.205839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 200/399] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:24 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:25.212025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:25.321454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16da9b-7725-4d65-9af3-61ac21369507 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:25.349894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:25.359413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91c56-d4a4-46a1-9426-e29448919b87 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.359707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91c56-d4a4-46a1-9426-e29448919b87 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.359961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91c56-d4a4-46a1-9426-e29448919b87 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.361463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 201/400] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:25.368184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0b66-c86a-4851-8720-4bf828a41203 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.368630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0b66-c86a-4851-8720-4bf828a41203 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.368989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0b66-c86a-4851-8720-4bf828a41203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.370507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:25.371381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.371834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.372289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.373639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:25.375285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:25.377434 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 200/401] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:25 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:25.383073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:25.390947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f30b0b66-c86a-4851-8720-4bf828a41203 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:25.392270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f30b0b66-c86a-4851-8720-4bf828a41203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:25.482433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 202/402] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:25.497857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641d71b-15fd-41f5-a81e-cd1d16aa921b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:25.513812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0b66-c86a-4851-8720-4bf828a41203 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:25.536416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:25.537444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.537917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.538398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da/groups/502add54a1944dc0aee480e13948de84/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.540670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] RBAC: Authorizing `identity:create_grant(project_id=3656add4314844e9b72312ec211f48da, group_id=502add54a1944dc0aee480e13948de84, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:25.542370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:25.561921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 201/403] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 28 22:02:25 2022] PUT /identity/v3/projects/3656add4314844e9b72312ec211f48da/groups/502add54a1944dc0aee480e13948de84/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:02:25.582973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:25.669001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0b66-c86a-4851-8720-4bf828a41203 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:25.709430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:25.710090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.710392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.710658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.725951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:25.731317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:25.732259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:25.733098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 203/404] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:25.739479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:25.805173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:25.861974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8234-c87b-4870-89a3-74c94da60867 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:25.907885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15825dad-403d-480b-a4ca-c31eca640fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:25.908870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825dad-403d-480b-a4ca-c31eca640fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.909351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825dad-403d-480b-a4ca-c31eca640fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.909852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15825dad-403d-480b-a4ca-c31eca640fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.911389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825dad-403d-480b-a4ca-c31eca640fc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:25.911928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825dad-403d-480b-a4ca-c31eca640fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:25.913529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15825dad-403d-480b-a4ca-c31eca640fc5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:25.928938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 202/405] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:25.934131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:25.953530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f6e74-34b9-4037-9237-0e954314453e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.953837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f6e74-34b9-4037-9237-0e954314453e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.954089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f6e74-34b9-4037-9237-0e954314453e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.955732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 203/406] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:25.961319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02bb14-7fb9-4edc-b466-082d5c9d8ce1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:25.961608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02bb14-7fb9-4edc-b466-082d5c9d8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:25.961887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02bb14-7fb9-4edc-b466-082d5c9d8ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:25.980540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-eb02bb14-7fb9-4edc-b466-082d5c9d8ce1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:25.981749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-eb02bb14-7fb9-4edc-b466-082d5c9d8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:26.063566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:26.072738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58073502-5ae0-4f46-9c5b-ff94cbd1418d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:26.143495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 204/407] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:26.145069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:26.145806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.146159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.146541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.149580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:26.150772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:26.152539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 204/408] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:25 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:26.157840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02bb14-7fb9-4edc-b466-082d5c9d8ce1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:26.181491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:26.222591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:26.332148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02bb14-7fb9-4edc-b466-082d5c9d8ce1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:26.385753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e052-bef8-46df-a361-b66cc162a663 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:26.400901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:26.401566 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.401846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.402121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.403341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:26.404805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:26.406888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 205/409] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:26 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:26.412729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:26.463323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:26.464024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.464257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.464528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.488183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:26.493796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:26.494712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:26.495503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:26.499863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 205/410] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:26.500705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:26.558323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:26.594672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce7968-441a-4fad-8b03-57f821f4b5f3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:26.607193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:26.635128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:26.635970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.636250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.636524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da/groups/502add54a1944dc0aee480e13948de84/roles/16d20d9321574453897849a9f649b636` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.640872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3656add4314844e9b72312ec211f48da, group_id=502add54a1944dc0aee480e13948de84, role_id=16d20d9321574453897849a9f649b636)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:26.642490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:26.661839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 206/411] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 28 22:02:26 2022] PUT /identity/v3/projects/3656add4314844e9b72312ec211f48da/groups/502add54a1944dc0aee480e13948de84/roles/16d20d9321574453897849a9f649b636 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:26.730000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abb74-dae4-48bc-bdc1-cb20a0ebfa96 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:26.768330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e365b37-ea97-400d-addb-7a18d39399f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:26.769007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365b37-ea97-400d-addb-7a18d39399f5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.769293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365b37-ea97-400d-addb-7a18d39399f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.769566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365b37-ea97-400d-addb-7a18d39399f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.770860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e365b37-ea97-400d-addb-7a18d39399f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:26.771207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e365b37-ea97-400d-addb-7a18d39399f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:26.772609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e365b37-ea97-400d-addb-7a18d39399f5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:26.784226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 206/412] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:26.792730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:26.920039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640dc58-82a8-4ed7-afbf-b8d360a3c7c2 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.920390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640dc58-82a8-4ed7-afbf-b8d360a3c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.920562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640dc58-82a8-4ed7-afbf-b8d360a3c7c2 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.922257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 207/413] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:26.926222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acfbf9-6bbc-44fa-9ff2-2102823ea0e4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:26.928203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f9c0-87d2-40bd-8c13-da543d1c0326 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.928486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f9c0-87d2-40bd-8c13-da543d1c0326 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.928754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721f9c0-87d2-40bd-8c13-da543d1c0326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.949708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c721f9c0-87d2-40bd-8c13-da543d1c0326 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:26.950978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c721f9c0-87d2-40bd-8c13-da543d1c0326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:26.968772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:26.969515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:26.969799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:26.970076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] PATH_INFO: `/v3/groups/570b786c3021478bab9158079ad2185e` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:26.971341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] RBAC: Authorizing `identity:get_group(group_id=570b786c3021478bab9158079ad2185e)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:26.973070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:26.975128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 207/414] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:26 2022] GET /identity/v3/groups/570b786c3021478bab9158079ad2185e => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:26.980765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:27.047123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:27.067797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 208/415] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:27.091410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721f9c0-87d2-40bd-8c13-da543d1c0326 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:27.131049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:27.146741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283ad45-f8f6-43f0-baf8-034f42f8d71d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:27.187662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:27.188588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:27.189031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:27.189491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] PATH_INFO: `/v3/projects/8855a1173a1b45fb8e20b8571862d2ed` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:27.190817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] RBAC: Authorizing `identity:get_project(project_id=8855a1173a1b45fb8e20b8571862d2ed)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:27.193845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:27.196054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 208/416] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:26 2022] GET /identity/v3/projects/8855a1173a1b45fb8e20b8571862d2ed => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:27.201333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:27.275573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721f9c0-87d2-40bd-8c13-da543d1c0326 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:27.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59c45d-00b0-462b-82c1-4965773b95fb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:27.317719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:27.318316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:27.318598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:27.318869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:27.323878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:27.330743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:27.337040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:27.338138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:27.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:27.341477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 209/417] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:27.348598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:27.358977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:27.359663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:27.359937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:27.360204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] PATH_INFO: `/v3/projects/8855a1173a1b45fb8e20b8571862d2ed/groups/570b786c3021478bab9158079ad2185e/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:27.362121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8855a1173a1b45fb8e20b8571862d2ed, group_id=570b786c3021478bab9158079ad2185e, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:27.363605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:27.384348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 209/418] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 28 22:02:27 2022] PUT /identity/v3/projects/8855a1173a1b45fb8e20b8571862d2ed/groups/570b786c3021478bab9158079ad2185e/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:02:27.438353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:27.469183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37560fa2-c67d-4608-a46a-1ea56f0f5ac2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:27.509756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:27.510685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:27.511103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:27.511536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:27.512419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:27.512858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:27.514480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:27.524951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 210/419] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:27.531015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:27.640280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610059b-9960-47b1-84e0-7fd56bcdd8a6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:27.685570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:27.686466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:27.686903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:27.687327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:27.729884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:27.774113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:27.775905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:27.883892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 210/420] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:27.890123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:27.999894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eeb5e-99de-4ea4-98e7-947278c4fa9d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:28.044260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bf7f8-f41f-4cbe-bc03-5e933d95df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:28.045161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf7f8-f41f-4cbe-bc03-5e933d95df85 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.045578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf7f8-f41f-4cbe-bc03-5e933d95df85 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.046000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf7f8-f41f-4cbe-bc03-5e933d95df85 None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.047334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bf7f8-f41f-4cbe-bc03-5e933d95df85 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:28.048897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bf7f8-f41f-4cbe-bc03-5e933d95df85 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:28.051058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 211/421] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:27 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:28.057229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:28.068135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313bf45-b18a-48ef-822f-db749f98de03 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.070570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313bf45-b18a-48ef-822f-db749f98de03 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.072145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313bf45-b18a-48ef-822f-db749f98de03 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.076302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 212/422] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:28.079931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721bcb-c439-4e8a-8f0b-ec4a054aaeff None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.080354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721bcb-c439-4e8a-8f0b-ec4a054aaeff None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.080846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a721bcb-c439-4e8a-8f0b-ec4a054aaeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.095136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:28.132693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5a721bcb-c439-4e8a-8f0b-ec4a054aaeff None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:28.135319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5a721bcb-c439-4e8a-8f0b-ec4a054aaeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:28.178595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:28.241088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac83a95-13f3-4918-b054-99503846efb3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:28.261931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 213/423] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:28.284109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:28.284761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.285042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.285317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.286538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:28.288046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:28.289991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 211/424] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:28 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:28.295782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a721bcb-c439-4e8a-8f0b-ec4a054aaeff None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:28.307900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:28.435774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a721bcb-c439-4e8a-8f0b-ec4a054aaeff None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:28.436102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68ebf6-f5e3-4261-a5ef-e2d5be7e4534 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:28.472372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f498ec-19db-4eff-87bc-1b8f42f3a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:28.474202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f498ec-19db-4eff-87bc-1b8f42f3a0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.474707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f498ec-19db-4eff-87bc-1b8f42f3a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.475161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f498ec-19db-4eff-87bc-1b8f42f3a0b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.476157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f498ec-19db-4eff-87bc-1b8f42f3a0b9 None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:28.476716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f498ec-19db-4eff-87bc-1b8f42f3a0b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:28.477416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:28.478119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.478485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.478813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.479453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f498ec-19db-4eff-87bc-1b8f42f3a0b9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:28.480706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:28.488481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 214/425] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:28 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:28.490783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4de3-e479-4db1-8dde-1cd4ecdd64de None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.491238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4de3-e479-4db1-8dde-1cd4ecdd64de None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.491658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4de3-e479-4db1-8dde-1cd4ecdd64de None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.492789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:28.497492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:28.497943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 215/426] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:28.499877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:28.500864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:28.501655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:28.502722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 212/427] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:28.503140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b45c7-421c-49ca-9797-cee3c50a2920 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.503914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b45c7-421c-49ca-9797-cee3c50a2920 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.504495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b45c7-421c-49ca-9797-cee3c50a2920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.511354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:28.539456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-627b45c7-421c-49ca-9797-cee3c50a2920 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:28.541075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-627b45c7-421c-49ca-9797-cee3c50a2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:28.636455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91604-370b-4738-8f40-bb899ae77eef None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:28.674635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:28.675516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.675796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.676067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.677364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:28.677666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:28.679258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:28.689860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 213/428] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:28.690797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 216/429] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:28.695128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:28.752068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b45c7-421c-49ca-9797-cee3c50a2920 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:28.791795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:28.845705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce7050-38a1-42d3-987b-f56d67914e03 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:28.891143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b45c7-421c-49ca-9797-cee3c50a2920 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:28.893284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:28.894592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.895615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.896260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.929139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:28.940164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:28.940610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:28.940889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:28.941154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:28.961472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:28.968304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:28.969237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 22:02:28.970063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:28.970705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 217/430] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:28.978113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:28.999547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.001833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.077545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:29.111428 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048394-f157-4cd5-b596-978b741a038b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.143524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 214/431] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:29.149122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.170720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc7b8f-158c-44be-8c10-8b9aa5759c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.171456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7b8f-158c-44be-8c10-8b9aa5759c77 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.172970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7b8f-158c-44be-8c10-8b9aa5759c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.173247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7b8f-158c-44be-8c10-8b9aa5759c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.174040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc7b8f-158c-44be-8c10-8b9aa5759c77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:29.174446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc7b8f-158c-44be-8c10-8b9aa5759c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.175881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc7b8f-158c-44be-8c10-8b9aa5759c77 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.187554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 218/432] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:29.188667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48695e7c-0948-4c5c-b5c1-c67a7c70e6a8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.188954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48695e7c-0948-4c5c-b5c1-c67a7c70e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.189223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48695e7c-0948-4c5c-b5c1-c67a7c70e6a8 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.191172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 219/433] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:29.195165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48695e7c-0948-4c5c-b5c1-c67a7c70e6a8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.271302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:29.279982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21438cf-c36f-4387-a041-afa7aa51b077 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.326266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b76e8d-46ea-4ee2-a67c-55d20bfe7bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.326909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b76e8d-46ea-4ee2-a67c-55d20bfe7bca None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.328047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b76e8d-46ea-4ee2-a67c-55d20bfe7bca None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.328047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b76e8d-46ea-4ee2-a67c-55d20bfe7bca None admin] PATH_INFO: `/v3/projects/e1c43f8201b34f6a8c1765c89e41545c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.330284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b76e8d-46ea-4ee2-a67c-55d20bfe7bca None admin] RBAC: Authorizing `identity:get_project(project_id=e1c43f8201b34f6a8c1765c89e41545c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.330887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b76e8d-46ea-4ee2-a67c-55d20bfe7bca None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.333115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 215/434] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/projects/e1c43f8201b34f6a8c1765c89e41545c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:29.334268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77386-8c03-4d66-94e3-ca8bdf5cfbf7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.334556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77386-8c03-4d66-94e3-ca8bdf5cfbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.334834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77386-8c03-4d66-94e3-ca8bdf5cfbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.337753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48695e7c-0948-4c5c-b5c1-c67a7c70e6a8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.354820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f8e77386-8c03-4d66-94e3-ca8bdf5cfbf7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:29.356041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f8e77386-8c03-4d66-94e3-ca8bdf5cfbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:29.376095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.376719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.377002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.377274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.378136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:29.431353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 216/435] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:29.439360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e77386-8c03-4d66-94e3-ca8bdf5cfbf7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.450299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.451763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.505172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:29.549283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e77386-8c03-4d66-94e3-ca8bdf5cfbf7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.561122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 220/436] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:29.561782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.592783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.593367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.593652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.593929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.595120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.596620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.602815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 217/437] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:29.602815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.637815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:29.673868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629891-c0d2-46dd-bbfc-1a556d4a36e1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.710033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.710695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.710974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.711243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.717852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2d555-f25e-45df-ad6c-126cfe2806ab None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.721507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:29.726792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:29.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:29.728440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 221/438] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:29.729118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.742318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:29.759767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.760419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.760698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.760970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.762128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.763629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.765302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 218/439] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:29.766044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.842949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7831-d0c5-4660-967a-85629b34e891 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.862168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:29.872732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99366e-6c0a-4f37-8f09-65a6a7d958e6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:29.881026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.881632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.881906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.882174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.883175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=16d20d9321574453897849a9f649b636, scope.project.id=e1c43f8201b34f6a8c1765c89e41545c) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:29.883483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.885012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.899143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 222/440] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=e1c43f8201b34f6a8c1765c89e41545c&role.id=16d20d9321574453897849a9f649b636 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:29.900043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:29.911819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:29.913185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:29.913695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:29.914169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:29.915220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:29.915757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:29.917452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:29.928154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 219/441] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:29.934682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.007339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:30.042142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d183e-a6c5-405a-9725-d0c51cfa7e8a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.043843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7174b-3bb0-4b22-a93d-8c20dfb04f0b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.082309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.083298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.083585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.083856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.085129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f0208-ac9c-4a4e-9778-d76f291d7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.085773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f0208-ac9c-4a4e-9778-d76f291d7b28 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.086056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f0208-ac9c-4a4e-9778-d76f291d7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.086351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f0208-ac9c-4a4e-9778-d76f291d7b28 None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.087518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f0208-ac9c-4a4e-9778-d76f291d7b28 None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.088939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f0208-ac9c-4a4e-9778-d76f291d7b28 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:30.090728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 223/442] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:30.091785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb732a-3e91-4e05-a659-beb48ea40551 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.093088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb732a-3e91-4e05-a659-beb48ea40551 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.093310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb732a-3e91-4e05-a659-beb48ea40551 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.094571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 224/443] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:30.099443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb732a-3e91-4e05-a659-beb48ea40551 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.115258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:30.179152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.180631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:30.236427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb732a-3e91-4e05-a659-beb48ea40551 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.275355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304addb-538c-4daf-bec3-ca59b539ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.275975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304addb-538c-4daf-bec3-ca59b539ed10 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.276254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304addb-538c-4daf-bec3-ca59b539ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.276525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304addb-538c-4daf-bec3-ca59b539ed10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.277362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304addb-538c-4daf-bec3-ca59b539ed10 None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=a56d5bfed1f74acdaacf5ccafad8ec18, scope.project.id=3656add4314844e9b72312ec211f48da) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:30.277652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304addb-538c-4daf-bec3-ca59b539ed10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.279149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304addb-538c-4daf-bec3-ca59b539ed10 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:30.284869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 225/444] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:30 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=a56d5bfed1f74acdaacf5ccafad8ec18 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:30.287636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450b37-bb3d-4b9c-b3e3-120093804606 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.287929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450b37-bb3d-4b9c-b3e3-120093804606 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.288206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450b37-bb3d-4b9c-b3e3-120093804606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.300843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 220/445] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 22:02:30.302476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:30.307268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.309306 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c1450b37-bb3d-4b9c-b3e3-120093804606 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:30.310563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c1450b37-bb3d-4b9c-b3e3-120093804606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:30.367175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:30.388984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 226/446] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:30.412223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1450b37-bb3d-4b9c-b3e3-120093804606 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.424992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b625-d184-42da-960e-d6d171d0bfd6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.474806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.475455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.475739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.476009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] PATH_INFO: `/v3/projects/3656add4314844e9b72312ec211f48da` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.477194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] RBAC: Authorizing `identity:get_project(project_id=3656add4314844e9b72312ec211f48da)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.479045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:30.481250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 221/447] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:30 2022] GET /identity/v3/projects/3656add4314844e9b72312ec211f48da => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:30.488479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.536933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1450b37-bb3d-4b9c-b3e3-120093804606 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.575844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.576485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.576760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.577028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.582895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:30.589445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:30.594626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:30.595519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:30.596368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 227/448] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:30.602030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.615574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1e4b-4557-455b-b34e-0ebc5929d196 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.642645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:30.659093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.659736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.660015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.660284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] PATH_INFO: `/v3/groups/502add54a1944dc0aee480e13948de84` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.662083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] RBAC: Authorizing `identity:get_group(group_id=502add54a1944dc0aee480e13948de84)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.663559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:30.665147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 222/449] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:30 2022] GET /identity/v3/groups/502add54a1944dc0aee480e13948de84 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:30.670946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.710522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a870d-8bc2-40e6-a19e-d5efb5c651f9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.743819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.744432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.744711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.745084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.745801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:30.746103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.747505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:30.760683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 228/450] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:30.766375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:30.768492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5dbb-66d2-40d5-862c-05c4d597dcbd None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.803713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.804321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.804597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.804867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.805638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] RBAC: Adding query filter params (group.id=502add54a1944dc0aee480e13948de84, role.id=16d20d9321574453897849a9f649b636, scope.project.id=3656add4314844e9b72312ec211f48da) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:30.805944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.807402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:30.812938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 223/451] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:30 2022] GET /identity/v3/role_assignments?group.id=502add54a1944dc0aee480e13948de84&scope.project.id=3656add4314844e9b72312ec211f48da&role.id=16d20d9321574453897849a9f649b636 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:30.829368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:30.875258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae36321-0398-41ff-9f36-3533983567e7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:30.911362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:30.911908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:30.912185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:30.912452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:30.981367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:30.982987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:31.039472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:31.082380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 229/452] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 22:02:31.087999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:31.146722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:31.194481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb685-6777-4b7f-b9d1-9771870d48d4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:31.225912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:31.226569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:31.226846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:31.227115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] PATH_INFO: `/v3/projects/8855a1173a1b45fb8e20b8571862d2ed` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:31.228247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] RBAC: Authorizing `identity:get_project(project_id=8855a1173a1b45fb8e20b8571862d2ed)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:31.229678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:31.231342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 224/453] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:02:31 2022] GET /identity/v3/projects/8855a1173a1b45fb8e20b8571862d2ed => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:31.236837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:31.332229 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b593c-b832-463c-a207-96bf380f4da5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:31.364349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc952dc9-8790-41da-b9fd-8f3b8981244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:31.364971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952dc9-8790-41da-b9fd-8f3b8981244c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:31.365248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952dc9-8790-41da-b9fd-8f3b8981244c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:31.365516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952dc9-8790-41da-b9fd-8f3b8981244c None admin] PATH_INFO: `/v3/groups/570b786c3021478bab9158079ad2185e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:31.366677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc952dc9-8790-41da-b9fd-8f3b8981244c None admin] RBAC: Authorizing `identity:get_group(group_id=570b786c3021478bab9158079ad2185e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:31.368090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc952dc9-8790-41da-b9fd-8f3b8981244c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:31.369641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 230/454] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 28 22:02:31 2022] GET /identity/v3/groups/570b786c3021478bab9158079ad2185e => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:31.375327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:31.471678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4d29-4b7b-495f-b7eb-e802f814354f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:31.491202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:31.505096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4fbb7-96ca-44e1-a9f1-17ce69f9c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:31.505698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fbb7-96ca-44e1-a9f1-17ce69f9c4df None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:31.505978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fbb7-96ca-44e1-a9f1-17ce69f9c4df None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:31.506272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fbb7-96ca-44e1-a9f1-17ce69f9c4df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:31.507050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4fbb7-96ca-44e1-a9f1-17ce69f9c4df None admin] RBAC: Adding query filter params (group.id=570b786c3021478bab9158079ad2185e, role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=8855a1173a1b45fb8e20b8571862d2ed) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:31.507357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4fbb7-96ca-44e1-a9f1-17ce69f9c4df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:31.508780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4fbb7-96ca-44e1-a9f1-17ce69f9c4df None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:31.514341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 225/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 28 22:02:31 2022] GET /identity/v3/role_assignments?group.id=570b786c3021478bab9158079ad2185e&scope.project.id=8855a1173a1b45fb8e20b8571862d2ed&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:33.880221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8124-c2cf-484f-94b3-b2fc15cc969a None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:33.880767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8124-c2cf-484f-94b3-b2fc15cc969a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:33.880767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8124-c2cf-484f-94b3-b2fc15cc969a None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:33.882075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 231/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:33.887548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322401-05f0-4dc6-88db-ef28bc3c0619 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:33.887965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322401-05f0-4dc6-88db-ef28bc3c0619 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:33.888131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322401-05f0-4dc6-88db-ef28bc3c0619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:33.912456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2d322401-05f0-4dc6-88db-ef28bc3c0619 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:33.913646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2d322401-05f0-4dc6-88db-ef28bc3c0619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:33.962366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb684-e48f-4b3f-9934-0c6107ab47ee None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:33.962672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb684-e48f-4b3f-9934-0c6107ab47ee None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:33.962919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb684-e48f-4b3f-9934-0c6107ab47ee None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:33.964482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 232/457] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:33.969325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b09d-4009-429c-894c-0bb9c5564a0c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:33.969609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b09d-4009-429c-894c-0bb9c5564a0c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:33.969882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2b09d-4009-429c-894c-0bb9c5564a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:33.990610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-37d2b09d-4009-429c-894c-0bb9c5564a0c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:33.992126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-37d2b09d-4009-429c-894c-0bb9c5564a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:34.019774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:34.020163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 226/458] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:34.078071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 233/459] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:34.093871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322401-05f0-4dc6-88db-ef28bc3c0619 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.104877 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2b09d-4009-429c-894c-0bb9c5564a0c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.233077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322401-05f0-4dc6-88db-ef28bc3c0619 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.248621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:34.257421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2b09d-4009-429c-894c-0bb9c5564a0c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.271573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1ab5a-a0c9-47b6-a209-e5c1c0e0a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.272508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ab5a-a0c9-47b6-a209-e5c1c0e0a616 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.273035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ab5a-a0c9-47b6-a209-e5c1c0e0a616 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.273474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ab5a-a0c9-47b6-a209-e5c1c0e0a616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.284466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1ab5a-a0c9-47b6-a209-e5c1c0e0a616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.286876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1ab5a-a0c9-47b6-a209-e5c1c0e0a616 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:34.293687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e585d-5616-4d71-8db7-df20759a1ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.294538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e585d-5616-4d71-8db7-df20759a1ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.294985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e585d-5616-4d71-8db7-df20759a1ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.295395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e585d-5616-4d71-8db7-df20759a1ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-8ff1ab5a-a0c9-47b6-a209-e5c1c0e0a616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:34.303018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:34.304059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:34.305101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:34.305101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:34.305101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:34.305101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:34.308598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e585d-5616-4d71-8db7-df20759a1ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.309055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 227/460] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:34.310366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d0030-3e8b-4666-847b-8c2469333902 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.310625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e585d-5616-4d71-8db7-df20759a1ed4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:34.310735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d0030-3e8b-4666-847b-8c2469333902 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.310909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d0030-3e8b-4666-847b-8c2469333902 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.312408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 228/461] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:34.313198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d0030-3e8b-4666-847b-8c2469333902 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-865e585d-5616-4d71-8db7-df20759a1ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:34.327893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:34.328953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:34.329915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:34.329915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:34.329915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:34.329915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:34.331654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 234/462] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:34.338087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5cd57-b848-4b00-8bad-8e06186299d1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.338603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5cd57-b848-4b00-8bad-8e06186299d1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.339027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5cd57-b848-4b00-8bad-8e06186299d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.357733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ada5cd57-b848-4b00-8bad-8e06186299d1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:34.359215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ada5cd57-b848-4b00-8bad-8e06186299d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:34.361441 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:34.429701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 235/463] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:34.430880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5cd57-b848-4b00-8bad-8e06186299d1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.439027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d0030-3e8b-4666-847b-8c2469333902 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.502504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.503633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.504054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.505082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.506016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:34.506503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.508016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:34.521816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 229/464] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:34.522865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.536936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5cd57-b848-4b00-8bad-8e06186299d1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.551836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:34.572113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.572733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.573018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.573288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.573975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:34.574302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.575756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:34.586762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:34.594158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 236/465] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:34.599327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.632757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d222c-c27e-4400-8b47-da1f5c885cb7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.668679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.669317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.669592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.669862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.680659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.682116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:34.698622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:34.699670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:34.700685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:34.700685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:34.700685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:34.700685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:34.701770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845283d1-3987-4a10-85ac-1f6497a3ad35 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.702190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 230/466] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:34.708093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.738031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.738738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.739232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.739651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.740560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.742238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:34.769152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 237/467] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:34 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:34.770871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:34.824862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:34.846679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:34.867601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c35e4-8605-4c69-8c13-2fe4949b67d2 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.919682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72429091-a694-4ae9-a68a-abf8445caa9d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:34.920706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557bd35-81cf-4377-ad40-6baa255f32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.921794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557bd35-81cf-4377-ad40-6baa255f32d9 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.922223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557bd35-81cf-4377-ad40-6baa255f32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.922668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557bd35-81cf-4377-ad40-6baa255f32d9 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.923512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557bd35-81cf-4377-ad40-6baa255f32d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.925180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557bd35-81cf-4377-ad40-6baa255f32d9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:34.950975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 231/468] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:34 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:34.952675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad6b83-1793-4579-afca-824919d4fab3 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.953107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad6b83-1793-4579-afca-824919d4fab3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.953538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad6b83-1793-4579-afca-824919d4fab3 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.955055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 232/469] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:34.960899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be8fd-da2c-4994-b66e-65fde7643eb4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.961452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be8fd-da2c-4994-b66e-65fde7643eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.961873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be8fd-da2c-4994-b66e-65fde7643eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.982949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:34.983601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:34.983880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:34.984150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:34.984400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-764be8fd-da2c-4994-b66e-65fde7643eb4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:34.984869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:34.985171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:34.986174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-764be8fd-da2c-4994-b66e-65fde7643eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:34.986783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:35.007497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 238/470] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:35.013574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:35.070502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 233/471] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:35.109282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764be8fd-da2c-4994-b66e-65fde7643eb4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:35.173264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09d26d-b576-4e1d-97cb-01435399cb15 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:35.191664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:35.193213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:35.219148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:35.220051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:35.220479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:35.221066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:35.222727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:35.225314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:35.243919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764be8fd-da2c-4994-b66e-65fde7643eb4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:35.254312 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 239/472] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:35 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:35.303263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3088-26ab-4841-9a9e-ed97d84c192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:35.304312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3088-26ab-4841-9a9e-ed97d84c192c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:35.304756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3088-26ab-4841-9a9e-ed97d84c192c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:35.305318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3088-26ab-4841-9a9e-ed97d84c192c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:35.319476 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a3088-26ab-4841-9a9e-ed97d84c192c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:35.322174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a3088-26ab-4841-9a9e-ed97d84c192c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-f27a3088-26ab-4841-9a9e-ed97d84c192c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:35.344885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:35.345973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:35.347006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:35.347006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:35.347006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:35.347006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:35.352209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 234/473] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:35.355466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:35.456905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111692-ea79-4bf1-ac87-8c94081a44af None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:35.458121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111692-ea79-4bf1-ac87-8c94081a44af None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:35.458640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111692-ea79-4bf1-ac87-8c94081a44af None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:35.463211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 235/474] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:35.465647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf38b-9293-4b22-a292-5e8fb1f8cf1e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:35.465926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf38b-9293-4b22-a292-5e8fb1f8cf1e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:35.466196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf38b-9293-4b22-a292-5e8fb1f8cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:35.494382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ad6cf38b-9293-4b22-a292-5e8fb1f8cf1e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:35.495541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ad6cf38b-9293-4b22-a292-5e8fb1f8cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:35.496195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0089d43-08f1-469f-bdcf-a4049b83a35c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:35.537849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:35.538516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:35.538886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:35.539166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:35.539863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:35.540261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:35.541647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:35.556550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 240/475] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:35.561844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:35.597984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 236/476] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:35.599065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:35.624459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf38b-9293-4b22-a292-5e8fb1f8cf1e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:35.673241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:35.685208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b51ec-7b71-4045-a838-0e1403fa58cb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:35.722203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:35.723230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:35.723688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:35.724161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:35.725022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:35.726665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:35.750978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf38b-9293-4b22-a292-5e8fb1f8cf1e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:35.765394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:35 2022] POST /identity/v3/users => generated 249 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:35.810151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:35.811192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:35.811653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:35.812198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:35.813134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:35.814902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:35.832984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.sql.core [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 22:02:35.832984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 22:02:35.832984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [parameters: {'id': 'e5cc8f0bc7314f269ec66438be5a10c7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 22:02:35.832984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80487) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application conn.query(q) Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application result.read() Jul 28 22:02:35.855072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 22:02:35.856019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application next(self.gen) Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application yield resource Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application next(self.gen) Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise self.value Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application session.commit() Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 22:02:35.856959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self.session.flush() Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application compat.raise_( Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 22:02:35.857821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 22:02:35.862474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application conn.query(q) Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application result.read() Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 22:02:35.863928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [parameters: {'id': 'e5cc8f0bc7314f269ec66438be5a10c7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:35.864726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 22:02:35.865591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:35.868076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 28 22:02:35 2022] POST /identity/v3/roles => generated 144 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:35.874014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:35.977485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:35.995022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9b026-f8e5-42af-b6d5-402831fb60b3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:36.031182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c1df-f651-4d17-9315-f8cabad80e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:36.032096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c1df-f651-4d17-9315-f8cabad80e25 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:36.032534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c1df-f651-4d17-9315-f8cabad80e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:36.032949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c1df-f651-4d17-9315-f8cabad80e25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:36.044374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711c1df-f651-4d17-9315-f8cabad80e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a711c1df-f651-4d17-9315-f8cabad80e25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:36.050127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:36.051709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 22:02:36.052549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:36.058285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:02:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:36.062127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:36.197460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951358b0-5f98-4b51-a99b-96cc6785908a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:36.209023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:36.237445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488cc65-522f-4354-b746-239aa764d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:36.238072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488cc65-522f-4354-b746-239aa764d1ea None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:36.238464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488cc65-522f-4354-b746-239aa764d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:36.239236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488cc65-522f-4354-b746-239aa764d1ea None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:36.240021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488cc65-522f-4354-b746-239aa764d1ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:36.240332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488cc65-522f-4354-b746-239aa764d1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:36.241713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488cc65-522f-4354-b746-239aa764d1ea None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:36.250443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:37.557771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a24e5-1a5f-4bae-a264-ac732b1a7323 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:37.558287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a24e5-1a5f-4bae-a264-ac732b1a7323 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:37.558287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a24e5-1a5f-4bae-a264-ac732b1a7323 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:37.559895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:37.565008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd70b4-73d7-463a-808f-5ffd9b3a512d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:37.565403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd70b4-73d7-463a-808f-5ffd9b3a512d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:37.565600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd70b4-73d7-463a-808f-5ffd9b3a512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:37.584793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fddd70b4-73d7-463a-808f-5ffd9b3a512d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:37.585967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fddd70b4-73d7-463a-808f-5ffd9b3a512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:37.596095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062959-d412-4f5e-b4d4-636304addc19 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:37.596389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062959-d412-4f5e-b4d4-636304addc19 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:37.596636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062959-d412-4f5e-b4d4-636304addc19 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:37.598265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 244/482] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:37.603249 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21d3c-0607-4631-b818-4e92c927fbc2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:37.603565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21d3c-0607-4631-b818-4e92c927fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:37.603820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21d3c-0607-4631-b818-4e92c927fbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:37.641042 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5be21d3c-0607-4631-b818-4e92c927fbc2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:37.642225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5be21d3c-0607-4631-b818-4e92c927fbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:37.674044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 239/483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:37.742982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd70b4-73d7-463a-808f-5ffd9b3a512d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:37.749275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 245/484] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:37.750825 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5d8b1-eed6-4029-8e21-5403131c0f90 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:37.751315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5d8b1-eed6-4029-8e21-5403131c0f90 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:37.752222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5d8b1-eed6-4029-8e21-5403131c0f90 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:37.755058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 246/485] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:37.761353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be70d4c-fdb5-43ab-91b4-a3e16f8294f6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:37.761986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be70d4c-fdb5-43ab-91b4-a3e16f8294f6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:37.762611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be70d4c-fdb5-43ab-91b4-a3e16f8294f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:37.783895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2be70d4c-fdb5-43ab-91b4-a3e16f8294f6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:37.785493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2be70d4c-fdb5-43ab-91b4-a3e16f8294f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:37.858032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 247/486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:37.859423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be70d4c-fdb5-43ab-91b4-a3e16f8294f6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:37.868275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:37.881727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd70b4-73d7-463a-808f-5ffd9b3a512d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:37.883313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:37.925784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:37.927239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:37.927517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:37.927784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:37.943973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:37.951031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:37.951951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:37.952734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:37.957693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 240/487] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:37.959505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.002794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be70d4c-fdb5-43ab-91b4-a3e16f8294f6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.050494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.051680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.051961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.052232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.062892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:38.068389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:38.070955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 248/488] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:38.073000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.094061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f5c13-1c64-465f-8131-d39c6f4a75f5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.146833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.148022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.148444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:38.149294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.149739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.165784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:38.172948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:38.173854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:38.174703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:38.178506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 241/489] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:38.179931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.200523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7166-07c4-4a0e-ae34-e3917c50fcec None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.207899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:38.246137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.247137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.247629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.248111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.249035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:38.249623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.251234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.260457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 249/490] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:38.261620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.323797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5282f9a-7002-4e2f-bef4-b168c4d49279 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.368756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.369379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.369658 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.369930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.370929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:38.371235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.373290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.375144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7a4f1-28ee-445c-b144-6fa886b08d4d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.386073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 242/491] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:38.387431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.413178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:38.423858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.424492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.424831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.425376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.426136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:38.426532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.428645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.439901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 250/492] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:38.440686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.494035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:38.510644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b4e27-c3c8-4d0b-9589-2e90ca8ee67b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.545179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2ad90-00f0-436a-84fb-44063821d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.545817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2ad90-00f0-436a-84fb-44063821d8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.546098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2ad90-00f0-436a-84fb-44063821d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.546401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2ad90-00f0-436a-84fb-44063821d8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.549295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99929-ec84-4712-885e-7fdf0d03c830 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.558249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2ad90-00f0-436a-84fb-44063821d8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.560131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2ad90-00f0-436a-84fb-44063821d8e7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-89e2ad90-00f0-436a-84fb-44063821d8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:38.575040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:38.576350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 243/493] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b6e8-4731-4e78-9ff4-fcb53a4f5a62 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b6e8-4731-4e78-9ff4-fcb53a4f5a62 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.578386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97b6e8-4731-4e78-9ff4-fcb53a4f5a62 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.583133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 244/494] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:38.583653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97b6e8-4731-4e78-9ff4-fcb53a4f5a62 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.591553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.592373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.592662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.592997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.605004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.606631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:38.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:38.624037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:38.624922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:38.624922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:38.624922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:38.624922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:38.624922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 251/495] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:38.625196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.672689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:38.697345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97b6e8-4731-4e78-9ff4-fcb53a4f5a62 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.731234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b9d9-8bc7-410e-8d41-321c426b539c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.733161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067cefe-59d3-4e6b-b98c-d7ce0012cf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.733915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067cefe-59d3-4e6b-b98c-d7ce0012cf3f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.734204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067cefe-59d3-4e6b-b98c-d7ce0012cf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.734509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067cefe-59d3-4e6b-b98c-d7ce0012cf3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.737279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:38.748224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067cefe-59d3-4e6b-b98c-d7ce0012cf3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.749826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067cefe-59d3-4e6b-b98c-d7ce0012cf3f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.765710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-c067cefe-59d3-4e6b-b98c-d7ce0012cf3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:38.765872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:38.766761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:38.768282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:38.768282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:38.768282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:38.768282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:38.768496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.768496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.768496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.768694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 245/496] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:38.768694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd058a2d-a6b2-430b-ac1d-0383f4e5ef2d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.768694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd058a2d-a6b2-430b-ac1d-0383f4e5ef2d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.769079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd058a2d-a6b2-430b-ac1d-0383f4e5ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.772018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:38.772398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.773783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.790652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 252/497] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:38.790652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.792004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bd058a2d-a6b2-430b-ac1d-0383f4e5ef2d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:38.793202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bd058a2d-a6b2-430b-ac1d-0383f4e5ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:38.862650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 246/498] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:38.864026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd058a2d-a6b2-430b-ac1d-0383f4e5ef2d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.900335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aadd50-3b47-42c6-9d0c-22870018b60f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.902000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:38.935980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:38.936525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:38.936808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:38.937083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:38.937767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:38.938082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:38.939477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:38.950511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 253/499] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:38.951311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:38.971993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd058a2d-a6b2-430b-ac1d-0383f4e5ef2d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:38.989824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.007412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb7958-1791-49da-967b-034d2e9cedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.008027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7958-1791-49da-967b-034d2e9cedd3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.008308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7958-1791-49da-967b-034d2e9cedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.008588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7958-1791-49da-967b-034d2e9cedd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.009280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb7958-1791-49da-967b-034d2e9cedd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:39.009586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb7958-1791-49da-967b-034d2e9cedd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.011002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb7958-1791-49da-967b-034d2e9cedd3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.021961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 247/500] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:39.023149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63153f7-be8b-4781-b847-c4ecd43ffafe None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.023436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63153f7-be8b-4781-b847-c4ecd43ffafe None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.023711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63153f7-be8b-4781-b847-c4ecd43ffafe None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.028968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 248/501] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:39.029613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63153f7-be8b-4781-b847-c4ecd43ffafe None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.052179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00501e-1654-4dc4-96eb-b6a16df3b1d5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.084212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.084843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.085124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.085393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.092843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.094317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:39.107204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:39.108240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 254/502] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:39.109737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.133911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.135214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63153f7-be8b-4781-b847-c4ecd43ffafe None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.168780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.169416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.169691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.169961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.180671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:39.186092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:39.187110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:39.187934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 249/503] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:39.188668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.212890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949537d-ba5b-40ef-b8c5-59e14d5b3224 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.228112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.248737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526f468-18c0-4ce6-8f62-f0fe71f0aba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.249405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f468-18c0-4ce6-8f62-f0fe71f0aba8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.249688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f468-18c0-4ce6-8f62-f0fe71f0aba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.250020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526f468-18c0-4ce6-8f62-f0fe71f0aba8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.257741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f468-18c0-4ce6-8f62-f0fe71f0aba8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.259232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526f468-18c0-4ce6-8f62-f0fe71f0aba8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c526f468-18c0-4ce6-8f62-f0fe71f0aba8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:39.270337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:39.271238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:02:39.272133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:39.276148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 255/504] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:39.277414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf796249-6e41-4bce-af74-e41fb8b62fbe None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.277705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf796249-6e41-4bce-af74-e41fb8b62fbe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.277978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf796249-6e41-4bce-af74-e41fb8b62fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.289007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384d8de-1dfc-4a23-a850-271770b7ee65 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.295523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bf796249-6e41-4bce-af74-e41fb8b62fbe None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:39.296718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bf796249-6e41-4bce-af74-e41fb8b62fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:39.322724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.323413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.323687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.323955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.331247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.333188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:39.345446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:39.346493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:39.347401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 250/505] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:39.348508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.368415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 256/506] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:39.369234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf796249-6e41-4bce-af74-e41fb8b62fbe None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.382801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.448764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.452805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea957-3f38-4603-96d5-69962a564fce None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.467656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf796249-6e41-4bce-af74-e41fb8b62fbe None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.487539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.488150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.488424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.488694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.489473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:39.489775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.491229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.500930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.501546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.501828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.502101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.502853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:39.503412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.504798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.512696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 257/507] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:39.513288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.530311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 251/508] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:39.531144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.586941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.612066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2363-ceff-4df3-b61e-0916a735d802 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.630194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc65ad-74da-4423-8915-73a95b960fb4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.647001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.647618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.647899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.648172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.648959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:39.649265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.650736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.664033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.664649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.664930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.665201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.665988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:39.666329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.667768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.684311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 252/509] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:39.685102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.691959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 258/510] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:39.692649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.703035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.787095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8988a4-b6e9-4396-8791-8e234139e882 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.790479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab5a6-52f8-484f-bb1b-27fd1fe63229 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.819360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.821129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.821963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.822307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.822544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.825143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.825844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.826133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.826440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.833125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.834643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.837141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:39.838659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:39.849322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:39.850363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:39.851322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:39.851322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:39.851322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:39.851322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:39.853346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:39.854198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:39.855492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:39.855492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:39.855492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:39.855492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:39.855701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 253/511] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:39.855701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.858435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 259/512] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:39.859430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:39.921252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:39.956358 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f51a5f-ce37-4b5c-b9ec-714b93f7bce1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.956508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f3f1e-bd63-42f8-9ce2-06bacc0553cc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:39.989398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.989828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:39.990008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.990314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.990461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:39.990586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:39.990744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:39.991018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.043451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.058589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.059921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.060056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.061367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.123565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.161172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 260/513] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:40.162019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.167332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 254/514] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:40.168077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.249586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.266169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3e4f4-2414-4f5e-840e-ee1fa1561602 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.266505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3ab6d-fd3b-4b51-9acf-6d713b756c79 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.299128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.299314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.299738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.299850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.300018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.300122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.300268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.300357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.301495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:40.301795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.303203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.315239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 255/515] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:40.315515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.343946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.371087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.372529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.414857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b4fa6-5f47-42a8-a025-518ae477dcd4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.447257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.447859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.448137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.448414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.449092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:40.449397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.450789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.454036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.462042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 256/516] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:40.462852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.475207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 261/517] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:40.476195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.545323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.562847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ee4a2-40e8-4a64-b0bd-3f319f06754e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.575949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e57704-c02e-460f-9d12-350ee8f3ce3a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.595382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.596023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.596299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.596592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.606879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.608128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.608317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.608750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.609024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.609290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.622080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.623543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:40.623636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:40.624492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:40.625340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:40.625340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:40.625340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:40.625340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:40.625340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 257/518] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:40.625613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:40.642651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:40.643503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:40.644335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:40.644335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:40.644335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:40.644335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:40.644335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 262/519] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:40.644650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.683050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.725819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93523e-b4fc-467d-8779-d80448f7498a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.749373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d3e71-96fa-4a3f-ac44-06654609f4bb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.759044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.759683 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.759957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.760236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.760907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.762363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.772486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.784763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 258/520] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:40 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:40.785017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.785551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.785938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.786350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.786733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.796689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.798863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:40.812506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:40.813644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 22:02:40.814782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:40.816133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 263/521] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:40.817613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.909893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f69b9-aa58-4902-87bd-2546f4599ea8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.933478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:40.941180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37431e05-c8f6-433a-85ec-012ab16b2c5e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:40.948262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.949041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.949424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.949796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.962137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.963640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.980358 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:40.980538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:40.981343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:40.982324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:40.982324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:40.982324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:40.982324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:40.982538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:40.982538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:40.982538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:40.982731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 259/522] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:40.982803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:40.982803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:40.983490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:40.984436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:40.997715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 264/523] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:40.998577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.035806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.095207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a749b-8aa2-4bbb-9060-d1bd242c9e97 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.109955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba4a3e-b364-47c1-a62d-51690b2829fe None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.133056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.134193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.134639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.135324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.136588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:41.137622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.139038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.147067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.147682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.147958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.148227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.149013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:41.149314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.150761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.156697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 260/524] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:41.156697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.174682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 265/525] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jul 28 22:02:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:41.176387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.192651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.269735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ec1c-2fa2-4acf-bfd4-e0eb9da7ba63 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.278761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.280691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f99f1-8e87-4505-ae25-7c6d0c87b607 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.309578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.310196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.310502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.310806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.311454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:41.311755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.313126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.317870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.318534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.318810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.319075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.329201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 261/526] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:41.329201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.330670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.333092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:41.346507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:41.347598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:41.348470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:41.352887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 266/527] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:41.353494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.433818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badbaac-4cca-44d8-b842-66a118993572 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.437572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.465619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b24f5-9a3e-4bbd-8460-bbcffa1c1666 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.472335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.473428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.473714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.473994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.481592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.483072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:41.495266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:41.496187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:41.497030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 262/528] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:41.497490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.506695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.507443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.507837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.508211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.531847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.578670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.580224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.612442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f7ee-95bc-4643-b45d-b9b1908db249 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.649472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.650114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.650441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.650718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.653382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.658594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.660091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:41.671584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:41.672625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:41.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 263/529] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:41.673962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.687539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 267/530] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:41.688379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.774480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.792809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1c4c-5a21-4960-a309-ab5e05076150 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.796658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dfcc8-0cde-443e-95c8-1c4e48a88365 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.831195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.831803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.832101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.832365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.832923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:41.833150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:41.833450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.834902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.837480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:41.837777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:41.838059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:41.840340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:41.840657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:41.843030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:41.861343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 268/531] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:41.861343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.875067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 264/532] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:41.875067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:41.901128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:41.968966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990260d6-bf4b-4ff3-8fe0-602ec4ec047a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:41.987708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b795d1c-aa4e-4e8a-9ce2-ba4a0b2df6e5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:42.004778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.005398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.005675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.005946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.006713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:42.007016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.008447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.025132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 269/533] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:42.025132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:42.033973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.034668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.034950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.035913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.049526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.051729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.059789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:42.072103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:42.072982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:42.073833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:42.073833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:42.073833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:42.073833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:42.074580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 265/534] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:42.075043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:42.123802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:42.131274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d246d3-6f57-4d1a-802b-ac66f487dbf2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:42.169604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.170264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.170531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.170801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.171580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=a2718132c4914dbda4582e259eccbaef) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:42.171890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.173318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.179623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 270/535] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:42 2022] GET /identity/v3/role_assignments?user.id=a2718132c4914dbda4582e259eccbaef&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:42.180422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:42.201457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895db1-1317-496d-b591-4ef089709914 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:42.249312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.250473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.250950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.251469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.252620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=fccb9c8b7ba54808ab77499297173498) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:42.253483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.255300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.262285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 266/536] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:42 2022] GET /identity/v3/role_assignments?user.id=fccb9c8b7ba54808ab77499297173498&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:42.263437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:42.323352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf89d3-ff2d-4cf6-b500-09060337e6f5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:42.349485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:42.401232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056144da-06fe-4662-9f63-d2145c5c89d7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:42.408924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.409721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.411068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.411068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.411908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=cf0b530da35f445d8241c16d8f51b16b) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:42.412307 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.413915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.435566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 271/537] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:42 2022] GET /identity/v3/role_assignments?user.id=cf0b530da35f445d8241c16d8f51b16b&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:42.442782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.443745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.444178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.444599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.445499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:42.445976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.447599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.462289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 267/538] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:42.470258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:42.517141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:42.617624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba94528-b13e-4e5b-aed8-53a18f011c4c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:42.658124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af46d6-8420-4428-9821-4be89b1f7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.658745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af46d6-8420-4428-9821-4be89b1f7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.659004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af46d6-8420-4428-9821-4be89b1f7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.659278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af46d6-8420-4428-9821-4be89b1f7ce9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.667692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af46d6-8420-4428-9821-4be89b1f7ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.669156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af46d6-8420-4428-9821-4be89b1f7ce9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-92af46d6-8420-4428-9821-4be89b1f7ce9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:42.680875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:42.681741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:42.682641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 272/539] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:42.687752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:42.831181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165112e-8214-4af6-9997-1831fd2a9365 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:42.860667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:42.882975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d6b33-d7c4-447d-8067-382b992b2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:42.883615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d6b33-d7c4-447d-8067-382b992b2e41 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.883960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d6b33-d7c4-447d-8067-382b992b2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.884238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d6b33-d7c4-447d-8067-382b992b2e41 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.885055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d6b33-d7c4-447d-8067-382b992b2e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:42.885367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d6b33-d7c4-447d-8067-382b992b2e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:42.886860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d6b33-d7c4-447d-8067-382b992b2e41 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:42.900074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6141d-a802-4e5a-b43d-3b47dec1d9f0 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.900399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6141d-a802-4e5a-b43d-3b47dec1d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.900523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 268/540] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:42.900774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6141d-a802-4e5a-b43d-3b47dec1d9f0 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.902161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 273/541] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:42.907899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22aa5-0023-484c-9162-a58ff6445225 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:42.908246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22aa5-0023-484c-9162-a58ff6445225 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:42.908468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22aa5-0023-484c-9162-a58ff6445225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:42.911989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6141d-a802-4e5a-b43d-3b47dec1d9f0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:42.932859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3ca22aa5-0023-484c-9162-a58ff6445225 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:42.934078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3ca22aa5-0023-484c-9162-a58ff6445225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:43.037624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 269/542] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:43.068932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22aa5-0023-484c-9162-a58ff6445225 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:43.076646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:43.099303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6141d-a802-4e5a-b43d-3b47dec1d9f0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:43.151521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:43.152476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:43.152950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:43.153434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:43.154581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=ba7594ae41184fb09cd2399b7f35616e) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:43.155314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:43.158175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:43.167937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 274/543] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:42 2022] GET /identity/v3/role_assignments?user.id=ba7594ae41184fb09cd2399b7f35616e&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:43.258083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22aa5-0023-484c-9162-a58ff6445225 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:43.277124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:43.311431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:43.312467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:43.312943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:43.313430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:43.330614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:43.335536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:43.336399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:43.337177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 270/544] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:43.342633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:43.492816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2a763-4199-4692-9383-6d3e7ef6566d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:43.544678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:43.545298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:43.545578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:43.545851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:43.546648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:43.546950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:43.548370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:43.561710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 275/545] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:43.567408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:43.712485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0377-af64-4b81-b058-244f50522057 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:43.756887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:43.757454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:43.757731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:43.757998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:43.773910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:43.775392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:43.796557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:43.797439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:43.798355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:43.798355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:43.798355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:43.798355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:43.798355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 271/546] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:43.803917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:43.825265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:43.961159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd39fce-2efb-49c4-9d24-bc5779ae56db None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:44.006211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:44.006862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.007191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.007407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.008095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:44.008397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:44.009771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:44.031571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 276/547] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:44.037230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:44.084802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:44.209077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359185-a5c4-412e-816a-a4eefaea8365 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:44.265392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:44.266416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.266904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.267583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.281873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:44.283631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:44.297969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:44.298974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:02:44.300360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:44.302788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 272/548] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:44.311344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:44.414663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:44.459535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3548-511d-4b8f-bdfe-84ab393b4892 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:44.502012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f186c43-6e16-42d7-be09-2789c2287ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:44.502667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186c43-6e16-42d7-be09-2789c2287ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.502949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186c43-6e16-42d7-be09-2789c2287ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.503487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186c43-6e16-42d7-be09-2789c2287ee0 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.504830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186c43-6e16-42d7-be09-2789c2287ee0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:44.505133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186c43-6e16-42d7-be09-2789c2287ee0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:44.506593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186c43-6e16-42d7-be09-2789c2287ee0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:44.531013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 277/549] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 28 22:02:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:44.536273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:44.653656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:44.672134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd839d4-44e8-4e6d-a226-4322b6b66b77 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:44.724814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:44.725453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.725741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.726015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.730529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc083d-6fdb-4497-b261-267b99ff0411 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.730812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc083d-6fdb-4497-b261-267b99ff0411 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.731082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc083d-6fdb-4497-b261-267b99ff0411 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.733678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 278/550] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:44.743606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b42de-7f2f-423e-909e-86eb29a1ebbd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.743886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b42de-7f2f-423e-909e-86eb29a1ebbd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.744161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b42de-7f2f-423e-909e-86eb29a1ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.770911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b25b42de-7f2f-423e-909e-86eb29a1ebbd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:44.772737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b25b42de-7f2f-423e-909e-86eb29a1ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:44.825884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:44.834249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:44.880732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 279/551] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:44.890725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721dfd6-b1f1-453d-a080-62539af21cb7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.891264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721dfd6-b1f1-453d-a080-62539af21cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.891698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721dfd6-b1f1-453d-a080-62539af21cb7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.893448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 280/552] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:44.907078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e0556-f420-4d74-9fd0-0e7682eb37d3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:44.907670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e0556-f420-4d74-9fd0-0e7682eb37d3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:44.908084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e0556-f420-4d74-9fd0-0e7682eb37d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:44.934698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-957e0556-f420-4d74-9fd0-0e7682eb37d3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:44.936301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-957e0556-f420-4d74-9fd0-0e7682eb37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:44.938749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:44.960383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 273/553] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:44.960383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.013355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.034251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 281/554] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 22:02:45.039165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e0556-f420-4d74-9fd0-0e7682eb37d3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.070594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81fd22-ca95-4f89-a1ee-21d32186dc1b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.108898 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe03dc7-cdbe-4e6c-b626-8885c6fad119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.109544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03dc7-cdbe-4e6c-b626-8885c6fad119 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.109821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03dc7-cdbe-4e6c-b626-8885c6fad119 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.110097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03dc7-cdbe-4e6c-b626-8885c6fad119 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.121133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe03dc7-cdbe-4e6c-b626-8885c6fad119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-efe03dc7-cdbe-4e6c-b626-8885c6fad119 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:45.126022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:45.127259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:45.128363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 274/555] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:45.129093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912bf6-1d06-45c8-aa35-1febb970dfae None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.129431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912bf6-1d06-45c8-aa35-1febb970dfae None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.129709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912bf6-1d06-45c8-aa35-1febb970dfae None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.135251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 275/556] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:45.136113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b912bf6-1d06-45c8-aa35-1febb970dfae None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.162851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e0556-f420-4d74-9fd0-0e7682eb37d3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.185745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.198796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.199437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.199715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.199985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.210735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:45.212177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:45.227389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:45.228356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:45.229232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:45.229232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:45.229232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:45.229232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:45.229232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 282/557] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:45.229517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.253599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b912bf6-1d06-45c8-aa35-1febb970dfae None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.276777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.290125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16980c-80c1-4b65-ad86-854f3cd4527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.290795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16980c-80c1-4b65-ad86-854f3cd4527b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.291075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16980c-80c1-4b65-ad86-854f3cd4527b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.291348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16980c-80c1-4b65-ad86-854f3cd4527b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.303354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16980c-80c1-4b65-ad86-854f3cd4527b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-bf16980c-80c1-4b65-ad86-854f3cd4527b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:45.308369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:45.309270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 276/558] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:45.310714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6a535-f4d0-44e1-8c51-a52fd986b3d1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.311447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6a535-f4d0-44e1-8c51-a52fd986b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.311447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6a535-f4d0-44e1-8c51-a52fd986b3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.328758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9ba6a535-f4d0-44e1-8c51-a52fd986b3d1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:45.329941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9ba6a535-f4d0-44e1-8c51-a52fd986b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:45.349604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc58fb-872e-41fc-8b26-73ae80180ac7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.386061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.386630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.386906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.387173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.387881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:45.388183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:45.389545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:45.403540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 283/559] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:45.403540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.406093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 277/560] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:45.411231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6a535-f4d0-44e1-8c51-a52fd986b3d1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.446760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.511930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.515302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7983-14dc-4efd-b9a0-3b3fd2a5d5c4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.517830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6a535-f4d0-44e1-8c51-a52fd986b3d1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.552417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.553032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.553310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.553576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.554278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:45.554582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:45.555949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:45.561954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.562607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.562885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.563157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.563867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:45.564168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:45.565520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:45.568330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 284/561] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:45.571647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.578799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 278/562] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:45.579684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.673071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9a2ac-a0b7-456b-8111-f70bc8b427ff None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.674972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.680628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d985c8d-000b-42d3-a00e-fd1d677326ea None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.707374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.708059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.708338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.708606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.714350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.714980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.715264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.715527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.718578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:45.720016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:45.725322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:45.730583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:45.731660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:45.732588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 279/563] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:45.733289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:45.734426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:45.735275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:45.736157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:45.736157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:45.736157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:45.736157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:45.736157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 285/564] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:45.736450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.752028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.837866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009afb1-974f-4098-ae43-433e1ede71d3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.841911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee66773-6c95-401f-8c85-f47b76cfdf43 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:45.872180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d94d-4f93-4985-8e35-526b8d3ad850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.873086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d94d-4f93-4985-8e35-526b8d3ad850 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.873460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d94d-4f93-4985-8e35-526b8d3ad850 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.873668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d94d-4f93-4985-8e35-526b8d3ad850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.875770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:45.876828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.877338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.877830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.881791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d94d-4f93-4985-8e35-526b8d3ad850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:45.883432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d94d-4f93-4985-8e35-526b8d3ad850 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:45.890105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:45.891566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-4d47d94d-4f93-4985-8e35-526b8d3ad850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:45.895540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:45.896416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 280/565] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73e10-630f-4076-951c-571c5412eb0f None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:45.902300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73e10-630f-4076-951c-571c5412eb0f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:45.902914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73e10-630f-4076-951c-571c5412eb0f None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:45.902914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 281/566] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:45.902914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73e10-630f-4076-951c-571c5412eb0f None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:45.910387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:45.911446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:45.912706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:45.912706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:45.912706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:45.912706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:45.912706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 286/567] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:45.912706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:45.923147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:45.973115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.006460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73e10-630f-4076-951c-571c5412eb0f None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.010891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190250c-a31b-44f5-9d4c-acad29bcbf9a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.040484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.041092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.041369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.041639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.042381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.042686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.043393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e6979-e46c-4abb-b0d6-6fc9eccd7a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.043996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e6979-e46c-4abb-b0d6-6fc9eccd7a6a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.044100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.044274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e6979-e46c-4abb-b0d6-6fc9eccd7a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.044541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e6979-e46c-4abb-b0d6-6fc9eccd7a6a None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.045239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e6979-e46c-4abb-b0d6-6fc9eccd7a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.045513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e6979-e46c-4abb-b0d6-6fc9eccd7a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.046873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e6979-e46c-4abb-b0d6-6fc9eccd7a6a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.052324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 282/568] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.053099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.061839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 287/569] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.063047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208863a-bf11-446b-8efe-0c2dac8fcd28 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.063328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208863a-bf11-446b-8efe-0c2dac8fcd28 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.063599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208863a-bf11-446b-8efe-0c2dac8fcd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.081044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7208863a-bf11-446b-8efe-0c2dac8fcd28 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:46.082220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7208863a-bf11-446b-8efe-0c2dac8fcd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:46.136024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.166429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 288/570] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:46.166429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208863a-bf11-446b-8efe-0c2dac8fcd28 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.169033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c06ea3-ae4e-4afa-8d0f-6c7d25205e37 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.208835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.209369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.209644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.209910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.210678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.210978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.212401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.218376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.225094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 283/571] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.225886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.263235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208863a-bf11-446b-8efe-0c2dac8fcd28 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.295910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.296521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.296804 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.297077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.298063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.298063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.299460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.311166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 289/572] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.311945 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.322628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0a65-04f6-46ff-ae58-8e6c2e289094 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.356109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.356802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.357076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.357346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.364310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.368396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.369967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:46.385002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:46.386028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:46.387423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:46.387423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:46.387423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:46.387423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:46.387423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 284/573] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:46.387423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.415652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06cb56-5931-4629-a175-1045390663ea None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.429638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.449189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.449822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.450102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.450405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.457677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.459182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:46.470100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:46.471225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:46.472159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 290/574] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:46.473305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.487911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1f57e-bb45-46c0-97f7-5497cc402d11 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.521433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.522067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.522370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.522637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.532823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:46.538813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:46.539750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:46.540576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 285/575] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:46.541253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.577541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013d4af-cf92-434b-b47d-db99295ebaa1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.592143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.610058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.610681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.610959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.611222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.611985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=92ef4880fa1f413c8f553ebee43d4c1d) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.612285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.614240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.619406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 291/576] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/role_assignments?user.id=92ef4880fa1f413c8f553ebee43d4c1d&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.620175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.652918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd6927-3ccb-4c55-af10-90430b5aa95e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.666140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.692009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.692934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.693216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.693504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.701910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.703462 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:46.716721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:46.717738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 286/577] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:46.719640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.742547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ddfb0-a1ee-4623-98b4-3d8c87b5b483 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.780863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.781549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.781829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.782107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.782942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.783251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.784632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.797545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 292/578] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.798465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.838567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf142b-ec40-4b5b-ba9a-014d56bc7ad4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.850398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.877223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.877848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.878459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.878772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.879573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.879881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.881311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.899689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:46.900919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 287/579] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.901804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:46.908634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f7c5e-7b4a-4ae5-8a51-c67f10982e72 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:46.954186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:46.954828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:46.955107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:46.955401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:46.956122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:46.956422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:46.958426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:46.966695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 293/580] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:46.967540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.024554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f26928-b2e1-44da-9845-58c5e5472ce2 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.060907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.061558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.061831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.062098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.062918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:47.063221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.064636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.073205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb656fa5-d495-4db5-934b-576f469d2d5f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.086973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 288/581] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:47.087706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.116071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.116540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.117280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.117834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.117834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.125967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.127436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:47.139217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:47.140343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 294/582] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:02:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:47.146777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.168441 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.208041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44f264-1cbc-4e75-9db1-15cc72419968 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.243221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.243787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.244061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.244326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.254812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659afc1-3180-42c5-be19-df362cfb1d25 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.255751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.257266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:47.273124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:47.274262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:47.275731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:47.275731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:47.275731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.275731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:47.275731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 289/583] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:47.275731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.295960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.296752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.297031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.297303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.309087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.310698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:47.325994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:47.327087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:47.328050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:47.328050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:47.328050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.328050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:47.328050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 295/584] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:47.328654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.364179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.389552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9181b-278c-407c-ab68-b953f04d1b50 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.403091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.426479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.427211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.427501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.427775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.433270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de6be7-d35f-40f6-a598-aa4148ae6afe None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.438538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.440008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:47.454765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:47.455651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:47.456527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:47.456527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:47.456527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.456527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:47.456527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 290/585] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:47.457406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.472427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.473044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.473324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.473601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.474417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:47.474724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.476138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.493986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 296/586] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:47.494990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.562105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a5e10-ce6e-4f68-9e01-ddee25bba7f1 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.594371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.601380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.602003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.602310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.602584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.603284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:47.603590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.604962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.606668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a560785-3de4-4d37-a86b-af349f51a8ef None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.618269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 291/587] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:47.619127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.642011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.648995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.649627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.649885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.650152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.650860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:47.651157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.652492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.664223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 297/588] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:47.669386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.729132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64bfa0-e49c-4733-bde1-ae1b5720599c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.767226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.768086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.768526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.768796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.769515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:47.769821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.771225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.778308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc9eb6-949a-4987-b935-90fdf9100da3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.787806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 292/589] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:47.788956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.815127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.815761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.816058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.816914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.828012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.829586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.843311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:47.844285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:47.845250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:47.846142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:47.846142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:47.846142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:47.846142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:47.846142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 298/590] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:47.846847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.894637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:47.903389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b8732-8e9d-4716-b00a-86c7bcb3919f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.946225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.947224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.947826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.948525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:47.951032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d29a9-597f-45ce-ab7d-457309d4c287 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:47.957454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:47.959500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:47.971235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:47.972239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:47.973858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:47.975602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 293/591] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:47.976511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:47.994207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:47.994876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:47.995157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:47.995426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.004184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.005615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:48.016890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:48.017899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 299/592] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:48.018893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.088942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5382d-1512-4fbd-824e-55a90d1af476 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.102129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.129482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.130129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.130444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.130719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.140607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.142071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.142329 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb25264-2a5e-4129-ba4b-8ea01bdbb1b7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.144109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:48.155359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:48.156282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:48.157197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 294/593] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:48.157696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.186182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.186839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.187108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.187378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.188130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:48.188432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.189839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.202882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 300/594] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:48.203732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.269645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8fdf8-accc-4a99-92a3-15f29a570376 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.305653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.306304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.306626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.306902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.307642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:48.307956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.309378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.310014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42fbf-5948-4f5b-a257-94e1ec59d9cb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.321879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 295/595] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:48.322643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.348354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.348974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.349246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.349507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.350321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:48.350622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.352040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.355199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.371978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 301/596] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:48.372810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.395956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.440010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4708f-2ca8-40ab-bb23-3dd4434ac2b4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.478975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.479604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.479883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.480152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.480899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:48.481201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.482728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.483501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507d0e5-b057-4b4e-a784-8a03e50206c9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.495739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 296/597] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:48.496605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.524722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.525431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.525714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.525984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.532891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.534346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:48.546161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:48.547283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 302/598] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:48.548220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.597098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.608280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba3925-32a4-49b2-a408-4cece6caefed None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.632580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.641746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.642437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.642718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.642994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/fccb9c8b7ba54808ab77499297173498/roles/d897affd236f4dcc9e85a147bfe9d820` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.652619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd455a0-6060-4315-9610-775dccae8cd7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.657486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=fccb9c8b7ba54808ab77499297173498, role_id=d897affd236f4dcc9e85a147bfe9d820)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.658954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.682266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 297/599] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:48 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/fccb9c8b7ba54808ab77499297173498/roles/d897affd236f4dcc9e85a147bfe9d820 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:48.682266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.696189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.696854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.697135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.697409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.709346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.710871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:48.726829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:48.727936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:48.729088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:48.729088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:48.729088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:48.729088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:48.732641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 303/600] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:48.733621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.787742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd41b77-5c95-46a0-b46c-a67b515fec0f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.826479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b64ccb-4032-48cf-82fc-2c3e55ecc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.827421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b64ccb-4032-48cf-82fc-2c3e55ecc387 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.827702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b64ccb-4032-48cf-82fc-2c3e55ecc387 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.827976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b64ccb-4032-48cf-82fc-2c3e55ecc387 None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/a2718132c4914dbda4582e259eccbaef/roles/d897affd236f4dcc9e85a147bfe9d820` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.843630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.850280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b64ccb-4032-48cf-82fc-2c3e55ecc387 None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=a2718132c4914dbda4582e259eccbaef, role_id=d897affd236f4dcc9e85a147bfe9d820)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.850280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b64ccb-4032-48cf-82fc-2c3e55ecc387 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.854707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3e8a-dbd3-442d-a1f7-772d0af8d997 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:48.864825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 298/601] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:48 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/a2718132c4914dbda4582e259eccbaef/roles/d897affd236f4dcc9e85a147bfe9d820 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:48.866990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de858f0-37cb-4682-b5c0-96697a9c6d88 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.867466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de858f0-37cb-4682-b5c0-96697a9c6d88 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.867914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de858f0-37cb-4682-b5c0-96697a9c6d88 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.874570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 299/602] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:48.875416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de858f0-37cb-4682-b5c0-96697a9c6d88 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:48.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:48.900606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88454dc9-0eb7-4f4e-ad76-0531d39b18c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:48.901247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454dc9-0eb7-4f4e-ad76-0531d39b18c2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.901525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454dc9-0eb7-4f4e-ad76-0531d39b18c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.901796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454dc9-0eb7-4f4e-ad76-0531d39b18c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.902644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88454dc9-0eb7-4f4e-ad76-0531d39b18c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:48.902950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88454dc9-0eb7-4f4e-ad76-0531d39b18c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:48.904497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88454dc9-0eb7-4f4e-ad76-0531d39b18c2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:48.923107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 304/603] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:48.924698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e201-d5ac-4c9b-86d8-f2ef965f655c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:48.924991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e201-d5ac-4c9b-86d8-f2ef965f655c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:48.925266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e201-d5ac-4c9b-86d8-f2ef965f655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:48.957737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d875e201-d5ac-4c9b-86d8-f2ef965f655c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:48.959205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d875e201-d5ac-4c9b-86d8-f2ef965f655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:49.022298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de858f0-37cb-4682-b5c0-96697a9c6d88 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:49.039495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 305/604] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:49.040354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e201-d5ac-4c9b-86d8-f2ef965f655c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.062051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:49.062714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:49.063055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:49.063327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:49.064029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:49.064330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:49.065823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:49.079982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 300/605] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:49.080809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.152483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:49.171401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e201-d5ac-4c9b-86d8-f2ef965f655c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:49.207788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:49.219567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aa55e-2a20-4f3d-9fcf-dea32ef8f5dc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:49.221376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:49.222116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:49.222571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:49.223601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/cf0b530da35f445d8241c16d8f51b16b/roles/d897affd236f4dcc9e85a147bfe9d820` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:49.239461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=cf0b530da35f445d8241c16d8f51b16b, role_id=d897affd236f4dcc9e85a147bfe9d820)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:49.241058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:49.266264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 306/606] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:49 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/cf0b530da35f445d8241c16d8f51b16b/roles/d897affd236f4dcc9e85a147bfe9d820 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:49.266264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.272630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:49.274035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:49.274633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:49.275127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:49.299455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:49.306871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:49.307811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:49.308676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:49.320287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 301/607] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:49.327461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.391075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dad1a-143c-46c0-b748-5dd217cbae41 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:49.479990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534a7f-8b5d-477a-90e7-3544a64a8159 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:49.493439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:49.494477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:49.494962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:49.495448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:49.499268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:49.504689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:49.507213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:49.521086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:49.522058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:49.523149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:49.526062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 307/608] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:49.530780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.534263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:49.534263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:49.534263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:49.534263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:49.534656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:49.534656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:49.536107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:49.545260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 302/609] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:49.551539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.588126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:49.724624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670da976-f8b1-4ce0-840e-64937570cc66 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:49.737881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fac2b-8084-4b24-bee4-5a2b70e697cb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:49.773143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:49.773786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:49.774065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:49.774390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:49.786499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:49.787949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:49.809997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:49.810931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:49.811826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:49.811826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:49.811826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:49.811826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:49.814528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 303/610] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:49.814992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:49.815611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:49.815888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:49.816189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:49.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:49.817246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:49.818776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:49.819827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.844009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 308/611] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:49.850714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:49.875148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:49.981331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818c7bc-8112-4884-bf65-6694582e86b5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:50.035876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:50.047972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:50.048607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.048886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.049158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.049863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:50.050165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:50.051766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:50.055634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da432c4-b07e-40e1-935e-cc3de4688f33 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:50.078130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 304/612] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:50.082982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:50.125963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:50.126706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.127042 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.127319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/ba7594ae41184fb09cd2399b7f35616e/roles/d897affd236f4dcc9e85a147bfe9d820` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.164579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=ba7594ae41184fb09cd2399b7f35616e, role_id=d897affd236f4dcc9e85a147bfe9d820)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:50.166031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:50.197603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 309/613] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:49 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/ba7594ae41184fb09cd2399b7f35616e/roles/d897affd236f4dcc9e85a147bfe9d820 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:50.226668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:50.243304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a2bbd-f4e2-4744-b9e7-04d88b50642e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:50.281517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:50.282153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.282468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.282742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.290534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:50.291999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:50.305310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:50.306356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:50.307305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 305/614] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:50.315762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:50.462209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43315-db4d-440f-b61d-a2bf30c7d104 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:50.513333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:50.513968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.514259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.514548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.515356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:50.515662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:50.517108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:50.536399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:50.543795 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 310/615] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 28 22:02:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:50.549255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:50.664041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f01abb-0e72-43a1-b145-d495cf9c711a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:50.701778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9037-bfde-4a0b-a901-e852622e4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:50.702454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9037-bfde-4a0b-a901-e852622e4fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.702735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9037-bfde-4a0b-a901-e852622e4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.703007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9037-bfde-4a0b-a901-e852622e4fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.714152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9037-bfde-4a0b-a901-e852622e4fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:50.715583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9037-bfde-4a0b-a901-e852622e4fe7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:50.718367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-606b9037-bfde-4a0b-a901-e852622e4fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:50.730815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:50.731745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:50.732794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:50.732794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:50.732794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:50.732794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:50.732794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 306/616] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:50.739578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:50.869975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef7832-bb2a-499e-b228-51926a0a9bfe None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:50.881618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b14f0c-46dd-450a-a72f-648666450427 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.881900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b14f0c-46dd-450a-a72f-648666450427 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.882177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b14f0c-46dd-450a-a72f-648666450427 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.883542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 307/617] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:50.896634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26c374-d864-4733-a708-58304d367091 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.896916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26c374-d864-4733-a708-58304d367091 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.897190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26c374-d864-4733-a708-58304d367091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.917234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:50.917858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:50.918136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:50.918430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:50.923464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:50.923792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:50.925176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:50.933145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-5f26c374-d864-4733-a708-58304d367091 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:50.934366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5f26c374-d864-4733-a708-58304d367091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:50.952227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 311/618] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:50.960220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.059342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:51.080646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 308/619] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:51.116720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c6b15-a0a1-4816-9760-629fb8b280e3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.140250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26c374-d864-4733-a708-58304d367091 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.161972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:51.163051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.163332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.163606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.173297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:51.174830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:51.205714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:51.206920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:51.207832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:51.210650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 312/620] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:51.213874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.319854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26c374-d864-4733-a708-58304d367091 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.335196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2d63f-e965-425b-a385-9c2d78368eed None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.357112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:51.359203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:51.369832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d074835-1c18-476c-a5aa-06acf32b5995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:51.370644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074835-1c18-476c-a5aa-06acf32b5995 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.370945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074835-1c18-476c-a5aa-06acf32b5995 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.371220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074835-1c18-476c-a5aa-06acf32b5995 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.376796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fa8e-263d-4e88-8626-894c56e120a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:51.377645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fa8e-263d-4e88-8626-894c56e120a8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.378360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fa8e-263d-4e88-8626-894c56e120a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.378729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fa8e-263d-4e88-8626-894c56e120a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.379633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fa8e-263d-4e88-8626-894c56e120a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:51.380090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fa8e-263d-4e88-8626-894c56e120a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:51.381578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fa8e-263d-4e88-8626-894c56e120a8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:51.382630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d074835-1c18-476c-a5aa-06acf32b5995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-3d074835-1c18-476c-a5aa-06acf32b5995 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:51.388108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:51.389971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:51.391103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:51.395089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 309/621] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:51.396565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331ba71-3d26-490c-87a5-fc852483b290 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.396856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331ba71-3d26-490c-87a5-fc852483b290 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.397731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331ba71-3d26-490c-87a5-fc852483b290 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.399640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 310/622] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:51.400355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331ba71-3d26-490c-87a5-fc852483b290 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.403256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 313/623] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:51.407808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312694-0d45-45d7-a9fc-a82453e4313d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.408226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312694-0d45-45d7-a9fc-a82453e4313d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.408600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312694-0d45-45d7-a9fc-a82453e4313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.428117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f0312694-0d45-45d7-a9fc-a82453e4313d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:51.429467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0312694-0d45-45d7-a9fc-a82453e4313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:51.506463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 314/624] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:51.507498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312694-0d45-45d7-a9fc-a82453e4313d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.532022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331ba71-3d26-490c-87a5-fc852483b290 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.585663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:51.586734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.587202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.587667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.589439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:51.590327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:51.592927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:51.614341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 311/625] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:51.616327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.651859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312694-0d45-45d7-a9fc-a82453e4313d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.664900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:51.679241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:51.692936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:51.693595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.693869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.694139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/92ef4880fa1f413c8f553ebee43d4c1d/roles/d897affd236f4dcc9e85a147bfe9d820` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.711104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=92ef4880fa1f413c8f553ebee43d4c1d, role_id=d897affd236f4dcc9e85a147bfe9d820)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:51.712879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:51.725875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 315/626] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:02:51 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/92ef4880fa1f413c8f553ebee43d4c1d/roles/d897affd236f4dcc9e85a147bfe9d820 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:02:51.726689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.745303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c780d3-d97b-439c-91ee-278436593b27 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.797068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6fb76-6d8b-4609-93fd-e0cccd138b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:51.798040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6fb76-6d8b-4609-93fd-e0cccd138b07 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.799110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6fb76-6d8b-4609-93fd-e0cccd138b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.799696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6fb76-6d8b-4609-93fd-e0cccd138b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.817722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6fb76-6d8b-4609-93fd-e0cccd138b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-fcb6fb76-6d8b-4609-93fd-e0cccd138b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:51.826169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:51.827320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:51.828488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:51.832189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 312/627] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:51.833725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7170-3e28-4dd6-b53f-3fe2fb261c04 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.834185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7170-3e28-4dd6-b53f-3fe2fb261c04 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.834670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7170-3e28-4dd6-b53f-3fe2fb261c04 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.836571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 313/628] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:51.838704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e7170-3e28-4dd6-b53f-3fe2fb261c04 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:51.865053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4583bf-ad0a-4a0f-a19e-36aef37f76be None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.923304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae236770-288d-4787-94ac-003ded0b7a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:51.924164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236770-288d-4787-94ac-003ded0b7a92 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.924777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236770-288d-4787-94ac-003ded0b7a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.925261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236770-288d-4787-94ac-003ded0b7a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.939394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae236770-288d-4787-94ac-003ded0b7a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:51.941374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae236770-288d-4787-94ac-003ded0b7a92 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-ae236770-288d-4787-94ac-003ded0b7a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:51.964068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:51.965014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:51.965975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:51.965975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:51.965975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:51.965975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:51.966199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 316/629] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:51.967900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3281f-774c-474d-9e18-d00fba003218 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:51.968183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3281f-774c-474d-9e18-d00fba003218 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:51.968456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3281f-774c-474d-9e18-d00fba003218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:51.973215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e7170-3e28-4dd6-b53f-3fe2fb261c04 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:51.984024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:51.991891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2ea3281f-774c-474d-9e18-d00fba003218 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:51.993338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2ea3281f-774c-474d-9e18-d00fba003218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:52.004725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:52.022763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.023387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.023662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.023929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.025169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:52.025477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.027416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.042320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 314/630] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:52.044006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.090410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 317/631] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:52.091213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3281f-774c-474d-9e18-d00fba003218 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.183939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecf18a-c88f-4ff5-a693-f3bd4d21eaf5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.221815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.222495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.222771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.223095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.223791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:52.224090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.226717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.243621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 315/632] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:52.244549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.247281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3281f-774c-474d-9e18-d00fba003218 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.280257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:52.291149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.291792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.292064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.292332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.304474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.306055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.308355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:52.324664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:52.325589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:52.326522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:52.326522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:52.326522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:52.326522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:52.330408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 318/633] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:52.331362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.372129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bac790-9961-46b2-bedf-de9544160975 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.411610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.412251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.412525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.412795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.426874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:52.432646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:52.434846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 316/634] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:52.436630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.460366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee57f-758b-44d5-a3bd-2bbeb10f1903 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.495822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.496776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.497151 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.497516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.507126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.508711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:52.520828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:52.522594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 319/635] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:52.524982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.540542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:52.554822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007a997-50f4-4bf8-9c4b-6f6e809eafbb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.589926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:52.594815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.595444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.595766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.596045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.596750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:52.598081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.599995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.617494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 317/636] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:52.618400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.639547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d6bd-5bf5-4773-bd4e-4fc19bd352f4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.676688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.677300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.677573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.677841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.678716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:52.679014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.680531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.689723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 320/637] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:52.690544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.730139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b671ad-e438-408f-8e82-44ceb4ea3a3d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.764736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.765369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.765649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.765926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.766748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:52.767053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.768487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.787604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 318/638] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:52.788465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.798869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:52.804321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225e491-81f1-47d2-ba64-2b9f69d844f2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.820915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:52.839494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617cb58-7029-4f68-84ab-4bca3c52a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.840132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617cb58-7029-4f68-84ab-4bca3c52a61d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.840409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617cb58-7029-4f68-84ab-4bca3c52a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.840677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617cb58-7029-4f68-84ab-4bca3c52a61d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.848894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617cb58-7029-4f68-84ab-4bca3c52a61d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.850357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617cb58-7029-4f68-84ab-4bca3c52a61d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b617cb58-7029-4f68-84ab-4bca3c52a61d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:52.862656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:52.863708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:52.864688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 321/639] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:52.865823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f73c-6870-40bc-8a9f-93f2c4c79b82 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.866354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f73c-6870-40bc-8a9f-93f2c4c79b82 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.866830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f73c-6870-40bc-8a9f-93f2c4c79b82 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.869875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 322/640] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:52.870938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f73c-6870-40bc-8a9f-93f2c4c79b82 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.914653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e208-8585-46d1-9e11-1732a318730c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:52.948805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:52.949425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:52.949702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:52.949972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:52.960838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:52.962395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:52.977904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:52.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:52.980121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:52.980121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:52.980121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:52.980121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:52.980121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 319/641] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:52.980121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:52.994815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f73c-6870-40bc-8a9f-93f2c4c79b82 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.035895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.036622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.036897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.037216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.045513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.085038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.087007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fce94-84cf-4256-8eba-14030dd5b0ab None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.113157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.114725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.126365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3caaa-0684-46d6-9779-360046f5d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.126991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3caaa-0684-46d6-9779-360046f5d510 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.127272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3caaa-0684-46d6-9779-360046f5d510 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.127543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3caaa-0684-46d6-9779-360046f5d510 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.128629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3caaa-0684-46d6-9779-360046f5d510 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:53.128937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3caaa-0684-46d6-9779-360046f5d510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.130382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3caaa-0684-46d6-9779-360046f5d510 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.150644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 320/642] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:53.151857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bf6cc-7795-4999-bec0-32972ade357b None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.152148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bf6cc-7795-4999-bec0-32972ade357b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.152423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bf6cc-7795-4999-bec0-32972ade357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.170603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ab8bf6cc-7795-4999-bec0-32972ade357b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:53.171739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ab8bf6cc-7795-4999-bec0-32972ade357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:53.233709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 323/643] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:53.234476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.245364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 321/644] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:53.246255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bf6cc-7795-4999-bec0-32972ade357b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.306886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.324034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.347971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71991f82-3511-48e5-b9bd-023471330664 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.361735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bf6cc-7795-4999-bec0-32972ade357b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.382905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.383530 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.383812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.384083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.384772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:53.385074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.386460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.402529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 324/645] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:53.402529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.403427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.404074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.404356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.404629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.478087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.479622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.504631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf4765-376d-4f65-a5b9-c804fc17464b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.529299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.540753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.541347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.541734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.541996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.545015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.554978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.556419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:53.571256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:53.572339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:53.573413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:53.573413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:53.573413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:53.573413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:53.573413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 325/646] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:53.573707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.590432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 322/647] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:53.591265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.691074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88e9f2-8754-4003-bc22-a710dec90ad0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.699565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fd08-0673-4ab7-b25f-109c8998077c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.727008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0716052-c928-4195-914f-60cab370da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.727650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716052-c928-4195-914f-60cab370da77 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.727926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716052-c928-4195-914f-60cab370da77 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.728252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716052-c928-4195-914f-60cab370da77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.735228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.735868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.736146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.736413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.738983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0716052-c928-4195-914f-60cab370da77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:53.743615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d0716052-c928-4195-914f-60cab370da77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:53.744747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:53.745905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:53.747022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:53.747787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.754201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 326/648] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:53.755289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0716052-c928-4195-914f-60cab370da77 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:53.756996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:53.758039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 323/649] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:53.759025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.772308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.809631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:53.859413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0716052-c928-4195-914f-60cab370da77 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.859746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b540b-1d30-4768-9cc6-a171d855b56d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:53.891318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.891918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.892192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.892481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.892928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0813-9eaf-400a-983f-eb77b3284662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:53.893154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:53.893451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.893569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0813-9eaf-400a-983f-eb77b3284662 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.893854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0813-9eaf-400a-983f-eb77b3284662 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.894659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0813-9eaf-400a-983f-eb77b3284662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.895325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.905707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c0813-9eaf-400a-983f-eb77b3284662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:53.906803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 327/650] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:53.907170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c0813-9eaf-400a-983f-eb77b3284662 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:53.907591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e05c0813-9eaf-400a-983f-eb77b3284662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:53.922161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:53.923297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:53.924190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:53.924190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:53.924190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:53.924190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:53.924190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 324/651] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:53.924555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126aa86-fde3-4bca-9523-b4932a524438 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:53.924781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126aa86-fde3-4bca-9523-b4932a524438 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:53.925000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126aa86-fde3-4bca-9523-b4932a524438 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:53.926421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 325/652] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:53.926929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126aa86-fde3-4bca-9523-b4932a524438 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:53.985382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.011479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99213cc-4911-4902-a1c1-51334e7a9880 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.021026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.027993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126aa86-fde3-4bca-9523-b4932a524438 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.044880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.045488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.045764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.046033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.046770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:54.047079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.048411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.056003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 328/653] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:54.056768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.064519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.065129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.065406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.065679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.067158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:54.067470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.068907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.086169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 326/654] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:02:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:54.086978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.163116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f7cd-f266-420e-b9fd-4a103781f85e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.187712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762f244-f798-4f92-bbcb-9b2e4020e470 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.195877 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddccd4d-c818-46a6-8aca-6cbd5e6be030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.196512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccd4d-c818-46a6-8aca-6cbd5e6be030 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.196786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccd4d-c818-46a6-8aca-6cbd5e6be030 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.197052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddccd4d-c818-46a6-8aca-6cbd5e6be030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.203850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddccd4d-c818-46a6-8aca-6cbd5e6be030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.205074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.205285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddccd4d-c818-46a6-8aca-6cbd5e6be030 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1ddccd4d-c818-46a6-8aca-6cbd5e6be030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:54.217118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:54.218084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:54.219023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 329/655] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:54.219535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697087-2905-41ef-8743-3cfa493b6549 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.219611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697087-2905-41ef-8743-3cfa493b6549 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.219943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697087-2905-41ef-8743-3cfa493b6549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.228920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.229764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.230044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.230346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.231494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:54.232014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.233424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.243590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-18697087-2905-41ef-8743-3cfa493b6549 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:54.244708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-18697087-2905-41ef-8743-3cfa493b6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:54.245092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 327/656] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:54.245898 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.272140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.315173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 330/657] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:54.316659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697087-2905-41ef-8743-3cfa493b6549 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.353471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68953a10-d476-4285-a8cd-f834e4087bef None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.394765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.395427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.395703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.395979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.410858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.412378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:54.427825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:54.428921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:54.430005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:54.430005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:54.430005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:54.430005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:54.430005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 328/658] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:54.430005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.438454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697087-2905-41ef-8743-3cfa493b6549 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.464002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.476430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.477155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.477508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.477849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.509859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.540096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffe03-8883-45bf-a290-ef6010e56f4a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.553094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.554574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.576134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.576756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.577036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.577314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.578067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:54.578406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.579840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.596886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 329/659] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:54.597814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.661737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 331/660] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:54.662603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.689707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.699171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ffa7b-3151-4057-93d3-123b968e0684 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.722899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.732700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.733336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.733613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.733889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.741056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.742532 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:54.753832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:54.754892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 330/661] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:54.755804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.766467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe1255-654e-4f94-b0a6-43efb691a971 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.799932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.801116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.801391 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.801661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.811994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:54.817156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:54.818290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 332/662] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:54.819350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.857359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed06c8-bc95-4805-9276-33aee598f126 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.890326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.890931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.891206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.891477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.892152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:54.892454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.893811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.905574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 331/663] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:54.906246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:54.918745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.923756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862dccc-406e-4024-bfb1-be894356e4c0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:54.944305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:54.958846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:54.959454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:54.959734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:54.960007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:54.960784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=fccb9c8b7ba54808ab77499297173498) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:54.961089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:54.962568 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:54.968147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 333/664] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/role_assignments?user.id=fccb9c8b7ba54808ab77499297173498&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:54.968914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.012988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6caa-22fe-487b-b800-78dd4f27750b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.054849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.055420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.055699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.055971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.068124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.069634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.085922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602311-2d66-427e-9ee6-ba46e90da111 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:55.086410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:55.087307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:55.088255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:55.088255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:55.088255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:55.088255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:55.088255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 332/665] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:55.088550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.130052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.130715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.130993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.132120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.135896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:55.135896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.135896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.149456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 334/666] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:55.150107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.169096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:55.199136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:55.221886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383ee08-4bd0-4dea-b277-383e0d15f453 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.258491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7c12-bd53-4963-a3bb-1b91a26d1a29 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.261435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.262194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.262576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.262922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.263708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:55.264080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.265529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.279219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 333/667] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:55.279219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.299685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.300449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.300800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.301155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.309074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.310479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:55.322684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:55.323660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 335/668] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:55.324618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.391719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33c1a7-5fbc-4145-a10a-cd635b18122a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.419563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:55.429069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.429774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.429890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e138f-a720-4504-ab2e-ebc45423b8c0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.430053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.430341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.431033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:55.431332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.432689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.433026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:55.445684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 334/669] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:55.446523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.471200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.472235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.472235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.472493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.473267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=a2718132c4914dbda4582e259eccbaef) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:55.473579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.475127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.486275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 336/670] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/role_assignments?user.id=a2718132c4914dbda4582e259eccbaef&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:55.486275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.591488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852946a4-b125-43e8-9e6f-88c676d6562e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.595951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e679c-37f1-415b-94b2-e33e71160bc8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.632027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.632688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.632969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.633303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.640732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.641905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.642186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.642485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.643694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:55.644035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.645832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.645935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.647729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.667206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 337/671] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:55.667423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:55.668678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:55.670695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:55.670695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:55.670695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:55.670695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:55.671214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.671427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 335/672] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:55.676007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.703470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:55.718582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:55.796202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2e33c-38d2-4f99-9293-80cde0c75d57 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.815451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87ed0f-d521-4576-977a-f89fc85e0e70 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:55.835089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.835946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.836372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.836812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.843962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.845567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.857801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:55.858375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:55.859426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:55.860437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:55.860869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:55.860869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:55.860869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:55.862687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 338/673] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:55.868000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:55.958115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:55.960230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:55.961036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:55.978525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db483-b669-4e36-8aa6-2dd4cb89eed5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.008352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:56.016425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.017282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.017818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.018256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.019747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:56.020206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.021705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.035420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 339/674] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:56.036458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.108610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 336/675] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:56.109427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.165627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c94d2-af6f-4414-8126-a9d0a5bb431c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.201223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.201895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.201895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.202035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.202799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:56.203104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.204540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.217631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 340/676] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:56.218655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.226956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:56.241801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22845a-b630-4127-a98a-79ffdac510cc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.289272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.289931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.290216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.290525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.294458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:56.301480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.303144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:02:56.320499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:56.321488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:02:56.322484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:56.326301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 337/677] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:56.327419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.349559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8f4c-2cff-457e-b84b-851b3f8ea804 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.391333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.391925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.392205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.392478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.405003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.406951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:56.425680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:56.426652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:56.427599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:56.427599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:56.427599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:56.427599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:56.430310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 341/678] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:56.431328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.461369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4809f5f-921c-4500-b2d8-1b351f0e96eb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.507054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.507942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:56.508310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.509024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.510027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.511423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=cf0b530da35f445d8241c16d8f51b16b) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:56.512040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.514509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.523087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 338/679] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/role_assignments?user.id=cf0b530da35f445d8241c16d8f51b16b&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:56.524218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.570885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b8cf-0f17-4f54-80dc-469a317fa6a4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.638873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:56.647127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.647681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.647959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.648227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.649036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:56.649339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.651082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.687962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 342/680] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:56.699383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.708553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad647f09-1648-4281-a24e-9d14b8367c8f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.750022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.751400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.751400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.751400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.751947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:56.752309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.754035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.767193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 339/681] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:56.774272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:56.833517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a9d7-e707-4cf8-9ada-2be62514eff5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.852584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:56.869884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.870700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.871033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.871370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.902967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcb26-50aa-48f2-99d9-063f8214f011 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:56.928465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:56.943541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.945190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.950017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:56.950927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:56.951419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:56.951876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:56.961436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:56.963424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:56.976234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:56.977159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:56.978068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:56.980695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 340/682] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:56.985959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.054263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 343/683] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:02:57.058116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.094268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:57.164522 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d2e8-77ce-4db2-a27f-6f541104ebfd None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.182257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755173-18b4-4dd3-9d83-408e74908d12 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.213448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b514b-1639-434b-9acd-770226896658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.214514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b514b-1639-434b-9acd-770226896658 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.214980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b514b-1639-434b-9acd-770226896658 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.215633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b514b-1639-434b-9acd-770226896658 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.215897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc2c3d-1545-497c-9322-b5d987e5c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.216605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc2c3d-1545-497c-9322-b5d987e5c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.216951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc2c3d-1545-497c-9322-b5d987e5c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.217334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc2c3d-1545-497c-9322-b5d987e5c4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.217821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b514b-1639-434b-9acd-770226896658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:57.218508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b514b-1639-434b-9acd-770226896658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.220654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b514b-1639-434b-9acd-770226896658 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.228598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc2c3d-1545-497c-9322-b5d987e5c4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.230249 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc2c3d-1545-497c-9322-b5d987e5c4e6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.235553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 341/684] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:57.237112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22d66-bcfa-41c7-9513-3d1e68f11f6e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.238083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22d66-bcfa-41c7-9513-3d1e68f11f6e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.238595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22d66-bcfa-41c7-9513-3d1e68f11f6e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.240879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 342/685] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:57.241970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22d66-bcfa-41c7-9513-3d1e68f11f6e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a8fc2c3d-1545-497c-9322-b5d987e5c4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:57.246526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:57.247444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:57.248349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:57.248349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:57.248349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:57.248349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:57.248349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:57.254637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d0d8c-fbc1-40c3-88c2-c99ed0741919 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.255131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d0d8c-fbc1-40c3-88c2-c99ed0741919 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.255464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d0d8c-fbc1-40c3-88c2-c99ed0741919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.276248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-696d0d8c-fbc1-40c3-88c2-c99ed0741919 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:57.277645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-696d0d8c-fbc1-40c3-88c2-c99ed0741919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:57.302876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:57.349009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:57.355327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 345/687] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:57.356527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d0d8c-fbc1-40c3-88c2-c99ed0741919 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.372369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22d66-bcfa-41c7-9513-3d1e68f11f6e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.411429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.412094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.412422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.412692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.413490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=ba7594ae41184fb09cd2399b7f35616e) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:57.413850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.415403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.423059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 343/688] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/role_assignments?user.id=ba7594ae41184fb09cd2399b7f35616e&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:57.423999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.548502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dcd14-2ed6-422f-b522-ede2ce87c54b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.551648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:57.588662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.589317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.589593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.589862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.590521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.591348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d0d8c-fbc1-40c3-88c2-c99ed0741919 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.592009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:57.604560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:57.605627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:57.606543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 344/689] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:57.614833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.663688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.664377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.665671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.665896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.667526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:57.667831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.670952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.692376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 346/690] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:57.699690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.764396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a045-86a8-4d5a-90db-c14c4febeab8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.770750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:57.803979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17061ca-37b8-47b5-910d-7d9af4e1b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.805052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17061ca-37b8-47b5-910d-7d9af4e1b210 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.805568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17061ca-37b8-47b5-910d-7d9af4e1b210 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.806061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17061ca-37b8-47b5-910d-7d9af4e1b210 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.807081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17061ca-37b8-47b5-910d-7d9af4e1b210 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:57.807657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17061ca-37b8-47b5-910d-7d9af4e1b210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.809245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17061ca-37b8-47b5-910d-7d9af4e1b210 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.813144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd2f90-980c-4143-972f-980fdea03bea None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.819699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 345/691] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:57.821340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438809a-4ed5-48c8-8bd8-e60427e87b23 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.821836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438809a-4ed5-48c8-8bd8-e60427e87b23 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.822345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438809a-4ed5-48c8-8bd8-e60427e87b23 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.824480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 346/692] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:57.825448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438809a-4ed5-48c8-8bd8-e60427e87b23 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.849682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb661bcf-af9b-4d25-8cd4-50a59ca87c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.850128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661bcf-af9b-4d25-8cd4-50a59ca87c71 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.850440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661bcf-af9b-4d25-8cd4-50a59ca87c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.850707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661bcf-af9b-4d25-8cd4-50a59ca87c71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.857729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb661bcf-af9b-4d25-8cd4-50a59ca87c71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.859330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb661bcf-af9b-4d25-8cd4-50a59ca87c71 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.866590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cb661bcf-af9b-4d25-8cd4-50a59ca87c71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:02:57.871663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:57.872571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:02:57.874049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 347/693] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:57.874560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786220-ac50-4cc8-b99e-361311261268 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.874560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786220-ac50-4cc8-b99e-361311261268 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.875193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786220-ac50-4cc8-b99e-361311261268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.895263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ee786220-ac50-4cc8-b99e-361311261268 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:57.896698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ee786220-ac50-4cc8-b99e-361311261268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:57.942541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438809a-4ed5-48c8-8bd8-e60427e87b23 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:57.967812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 348/694] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:57.968629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee786220-ac50-4cc8-b99e-361311261268 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:57.980759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:57.981695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:57.982208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:57.982732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:57.983736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:57.984322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:57.985956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:57.998406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 347/695] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:58.009529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:58.027118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:58.078910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee786220-ac50-4cc8-b99e-361311261268 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:58.155446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:58.156092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:58.156369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:58.156637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:58.157397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:58.157703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:58.159195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:58.172800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 349/696] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:58.178920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:58.196606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:58.201974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe61e01-9756-4ed9-a9b5-84f0b0b3e674 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:58.256041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:58.256686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:58.256980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:58.257554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:58.268870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:58.270372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:02:58.288086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:58.289034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:58.290387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:02:58.290387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:02:58.290387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:02:58.290387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:58.290387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 348/697] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:02:58.295313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:58.329022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1955-810e-4647-940d-b10ec4cfd907 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:58.339435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:58.388714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:58.389791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:58.390322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:58.390822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:58.391813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=92ef4880fa1f413c8f553ebee43d4c1d) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:58.392329 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:58.394002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:58.399217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc945-9ea2-49d1-bf5a-a9a74901b8e3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:58.406383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 350/698] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:02:58 2022] GET /identity/v3/role_assignments?user.id=92ef4880fa1f413c8f553ebee43d4c1d&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:02:58.436667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3539e1-5dbd-46e6-9186-41cf4b1f524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:58.437301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3539e1-5dbd-46e6-9186-41cf4b1f524d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:58.437581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3539e1-5dbd-46e6-9186-41cf4b1f524d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:58.437848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3539e1-5dbd-46e6-9186-41cf4b1f524d None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:58.438591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3539e1-5dbd-46e6-9186-41cf4b1f524d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:58.438895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3539e1-5dbd-46e6-9186-41cf4b1f524d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:58.440384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3539e1-5dbd-46e6-9186-41cf4b1f524d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:58.453976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 349/699] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:58.459423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:58.606721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343737-f31b-48ee-83ec-c58e29de8eae None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:58.642559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea936e8a-a312-49b9-a87b-c31b2b40aea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:58.643174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936e8a-a312-49b9-a87b-c31b2b40aea2 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:58.643449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936e8a-a312-49b9-a87b-c31b2b40aea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:58.643739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936e8a-a312-49b9-a87b-c31b2b40aea2 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:58.644416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea936e8a-a312-49b9-a87b-c31b2b40aea2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:58.645832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea936e8a-a312-49b9-a87b-c31b2b40aea2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:58.674116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 351/700] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:02:58 2022] POST /identity/v3/users => generated 254 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:02:59.196291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b879f-66b5-4b47-822e-c570d56c6b82 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:59.196852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b879f-66b5-4b47-822e-c570d56c6b82 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:59.196852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b879f-66b5-4b47-822e-c570d56c6b82 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:59.198585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 350/701] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:02:59.204088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b329-678e-4101-8918-1cb98aa3dcfb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:59.204379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b329-678e-4101-8918-1cb98aa3dcfb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:59.204657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434b329-678e-4101-8918-1cb98aa3dcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:59.231960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f434b329-678e-4101-8918-1cb98aa3dcfb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:02:59.233164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f434b329-678e-4101-8918-1cb98aa3dcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:02:59.273173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:59.343252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 352/702] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:02:59.377693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b879f-66b5-4b47-822e-c570d56c6b82 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:59.390294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:59.515057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b879f-66b5-4b47-822e-c570d56c6b82 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:59.557206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:59.557877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:59.558162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:59.558457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:59.575794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:02:59.580853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:02:59.581848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:02:59.583729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 351/703] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:02:59.589457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434b329-678e-4101-8918-1cb98aa3dcfb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:59.720437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434b329-678e-4101-8918-1cb98aa3dcfb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:59.765057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f75fd-6668-4cd5-b59d-bb88e0189848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:59.765686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f75fd-6668-4cd5-b59d-bb88e0189848 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:59.765965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f75fd-6668-4cd5-b59d-bb88e0189848 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:59.766250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f75fd-6668-4cd5-b59d-bb88e0189848 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:59.767023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f75fd-6668-4cd5-b59d-bb88e0189848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:02:59.767327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f75fd-6668-4cd5-b59d-bb88e0189848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:59.768783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f75fd-6668-4cd5-b59d-bb88e0189848 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:02:59.782155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 353/704] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:02:59.788353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:02:59.882986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:02:59.931561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ea906-4ce1-4cd8-98ae-43f0be655fb5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:02:59.979938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7277f9-ec2c-4653-95fd-0eba954e5c26 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:59.980127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7277f9-ec2c-4653-95fd-0eba954e5c26 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:59.980397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7277f9-ec2c-4653-95fd-0eba954e5c26 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:59.981863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 354/705] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:02:59.982207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:02:59.982882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:59.983157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:59.983428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:59.990375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f24f0-61af-464c-9046-8d368d77c409 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:02:59.990655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f24f0-61af-464c-9046-8d368d77c409 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:02:59.990932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f24f0-61af-464c-9046-8d368d77c409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:02:59.995639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:02:59.997164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:00.014329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:00.015303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:00.016202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:00.016202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:00.016202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:00.016202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:00.016202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 352/706] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:00.023069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.040491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-011f24f0-61af-464c-9046-8d368d77c409 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:00.041703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-011f24f0-61af-464c-9046-8d368d77c409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:00.073145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:00.185169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 355/707] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:03:00.198027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca2c7b-2668-4ada-a11b-52f17b864370 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:00.218637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:00.221379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f24f0-61af-464c-9046-8d368d77c409 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.266109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:00.266733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.267016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.267285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.267980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:00.268282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:00.270243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:00.291541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 353/708] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:00.299148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.345605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f24f0-61af-464c-9046-8d368d77c409 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:00.387865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:00.388515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.388792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.389060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] PATH_INFO: `/v3/services/network` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.389687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:00.392591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:00.416225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:00.417290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:00.418179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:00.419707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 356/709] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:00 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:00.424120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.445442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:00.519262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e839fb-119c-4b88-9484-f45656e3bf68 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:00.588690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dbb3-2bdb-43a2-b6fc-7f36b8304d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:00.589274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6055-4c8a-4243-8cfa-31213d6a8d3c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:00.589397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dbb3-2bdb-43a2-b6fc-7f36b8304d43 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.589622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dbb3-2bdb-43a2-b6fc-7f36b8304d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.589879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dbb3-2bdb-43a2-b6fc-7f36b8304d43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.598979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654dbb3-2bdb-43a2-b6fc-7f36b8304d43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:00.600168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654dbb3-2bdb-43a2-b6fc-7f36b8304d43 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e654dbb3-2bdb-43a2-b6fc-7f36b8304d43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:00.612261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:00.613312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:00.614879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 354/710] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:03:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:00.615485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29c2a-fef6-4bc0-9020-6d04c7eee13d None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.615485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29c2a-fef6-4bc0-9020-6d04c7eee13d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.615615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29c2a-fef6-4bc0-9020-6d04c7eee13d None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.620763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 355/711] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:00.620763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29c2a-fef6-4bc0-9020-6d04c7eee13d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.642486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac9ad5-b075-47bc-adf8-b0679c8d120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:00.644626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9ad5-b075-47bc-adf8-b0679c8d120c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.645131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9ad5-b075-47bc-adf8-b0679c8d120c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.645954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac9ad5-b075-47bc-adf8-b0679c8d120c None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.647237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac9ad5-b075-47bc-adf8-b0679c8d120c None admin] RBAC: Adding query filter params (name=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:00.648229 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac9ad5-b075-47bc-adf8-b0679c8d120c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:00.650377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac9ad5-b075-47bc-adf8-b0679c8d120c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:00.657423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 357/712] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:00.660258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f54bd-0247-44ba-85d8-aa00ddc6447d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.660839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f54bd-0247-44ba-85d8-aa00ddc6447d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.661640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f54bd-0247-44ba-85d8-aa00ddc6447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.666888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:00.688667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5c2f54bd-0247-44ba-85d8-aa00ddc6447d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:00.691698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5c2f54bd-0247-44ba-85d8-aa00ddc6447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:00.732390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29c2a-fef6-4bc0-9020-6d04c7eee13d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:00.770115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:00.770798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.771098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.771567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.772142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:00.772449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:00.773876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:00.792149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 358/713] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:03:00.792149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f54bd-0247-44ba-85d8-aa00ddc6447d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.798439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 356/714] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:00.804006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.809921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:00.911402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f54bd-0247-44ba-85d8-aa00ddc6447d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:00.945998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:00.948236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:00.949149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.949433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.949710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:00.950568 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] RBAC: Adding query filter params (type=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:00.950878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:00.952248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:00.952730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07926a40-3bdd-4e45-a0fc-91325428ad40 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:00.959328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 359/715] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:00.960148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:00.997385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:00.998030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:00.998335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:00.998611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.055584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:01.076355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:01.077869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:01.106252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95c33-0b50-4f58-ac90-85a4d76e0644 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:01.160160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af3729-a182-491f-bce9-13244d2e68fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:01.161148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3729-a182-491f-bce9-13244d2e68fc None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.161678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3729-a182-491f-bce9-13244d2e68fc None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.162170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3729-a182-491f-bce9-13244d2e68fc None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.163040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af3729-a182-491f-bce9-13244d2e68fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:01.164589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af3729-a182-491f-bce9-13244d2e68fc None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:01.190275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 360/716] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:00 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:01.190275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5b5a7-a2cf-4a5a-9df5-14bf4ab25f99 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.190275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5b5a7-a2cf-4a5a-9df5-14bf4ab25f99 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.190275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5b5a7-a2cf-4a5a-9df5-14bf4ab25f99 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.190803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 361/717] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:01.202460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039f5af-590d-43aa-85c6-50760e1bbb26 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.202772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039f5af-590d-43aa-85c6-50760e1bbb26 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.203019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039f5af-590d-43aa-85c6-50760e1bbb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.212813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:01.217861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 357/718] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:03:01.225377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:01.231759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3039f5af-590d-43aa-85c6-50760e1bbb26 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:01.233347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3039f5af-590d-43aa-85c6-50760e1bbb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:01.359775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77353359-f4a4-4ace-a11d-2466dcf30b4e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:01.369842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 362/719] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:03:01.416744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:01.417423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.417709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.417982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.434263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:01.435859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:01.443883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039f5af-590d-43aa-85c6-50760e1bbb26 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:01.453422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:01.454422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:01.455317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:01.455317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:01.455317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:01.455317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:01.456806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 358/720] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:01.461451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:01.522158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:01.525504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:01.572425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039f5af-590d-43aa-85c6-50760e1bbb26 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:01.591979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7c53c-0994-4ac4-a171-55ff3c2c3817 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:01.615769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0596d32-cbd5-4b48-ab9b-5cfd3aedfb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:01.616343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596d32-cbd5-4b48-ab9b-5cfd3aedfb75 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.616685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596d32-cbd5-4b48-ab9b-5cfd3aedfb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.616965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596d32-cbd5-4b48-ab9b-5cfd3aedfb75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.632097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0596d32-cbd5-4b48-ab9b-5cfd3aedfb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:01.636899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9603-455f-47c5-9a5a-6b4fb4b6e258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:01.637784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9603-455f-47c5-9a5a-6b4fb4b6e258 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b0596d32-cbd5-4b48-ab9b-5cfd3aedfb75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:01.637895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:01.638832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:01.640287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 363/721] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:01.641229 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb6924-7f11-4373-beac-34872570dbbd None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.641335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb6924-7f11-4373-beac-34872570dbbd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.641612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb6924-7f11-4373-beac-34872570dbbd None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.642009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9603-455f-47c5-9a5a-6b4fb4b6e258 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.642516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9603-455f-47c5-9a5a-6b4fb4b6e258 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.643141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 364/722] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:01.643768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9603-455f-47c5-9a5a-6b4fb4b6e258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:01.644315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9603-455f-47c5-9a5a-6b4fb4b6e258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:01.644712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb6924-7f11-4373-beac-34872570dbbd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:01.646016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9603-455f-47c5-9a5a-6b4fb4b6e258 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:01.667139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 359/723] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:01.673005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85cf07-04ae-4a71-900a-ce921c26a9f6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.673461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85cf07-04ae-4a71-900a-ce921c26a9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.673847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85cf07-04ae-4a71-900a-ce921c26a9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.694343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8d85cf07-04ae-4a71-900a-ce921c26a9f6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:01.695776 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8d85cf07-04ae-4a71-900a-ce921c26a9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:01.766589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb6924-7f11-4373-beac-34872570dbbd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:01.773042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 360/724] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:03:01.774119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85cf07-04ae-4a71-900a-ce921c26a9f6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:01.793585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:01.818707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:01.819473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.819759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.820030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.820778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:01.821763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:01.822686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:01.830285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:01.833012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 365/725] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:01.834660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:01.904464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85cf07-04ae-4a71-900a-ce921c26a9f6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:01.943220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932b400-f7b4-4429-bc63-20a8de38bfd3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:01.950744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:01.951638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.952064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.952481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:01.959659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:01.961440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:01.978139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:01.979220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:01.980129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:01.986871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 361/726] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:01.986871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:01.992467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:01.993377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:01.993873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:01.994411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.006170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:02.012093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:02.013111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:03:02.013967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:02.021474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 366/727] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:02.022618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.073984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:02.106694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:02.111846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636233-41a9-40d3-a2da-d03ec80dccf9 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.154580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.155182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.155668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.155878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.164207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5972-a7fb-4e48-8fe9-5124c95ace11 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.170064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.171564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:02.189520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:02.190506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:02.192002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:02.192002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:02.192002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:02.192002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:02.192002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 362/728] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:02.192002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.213809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.215116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.215586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.216063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.217020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:02.217509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.219963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.237014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 367/729] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:02.238134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.320114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7e14-38c8-4b8f-89ee-5afbfa9802c1 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.349354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:02.356001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2360a8-5424-46a5-a29f-ca8e99e9c4bd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.365077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.366125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.366287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.366577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.367369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:02.367746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.369449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.382636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 363/730] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:02.383666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.399090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.400506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.400940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.401382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.402377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:02.402690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:02.403007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.405305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.426365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 368/731] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:02.426365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.512944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946535b6-27b0-46f3-b0ac-53910a8347bc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.541862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef3f3-7da0-40d5-836e-6c03ecda6425 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.554343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.555108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.555497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.555872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.557159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=cf0b530da35f445d8241c16d8f51b16b) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:02.557577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.559259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.575234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 364/732] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/role_assignments?user.id=cf0b530da35f445d8241c16d8f51b16b&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:02.576227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.585594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.586500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.586945 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.587352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.607529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.609314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:02.625331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:02.626344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:02.627250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:02.627250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:02.627250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:02.627250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:02.630364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 369/733] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:02.635425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.679117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:02.750886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:02.798964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf4def-6c57-4e18-9418-a8d92714d3ed None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.832249 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535aaeb-6235-45b5-a671-090f471871b0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:02.867399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.868059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.868343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.868614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.884184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.885644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:02.905465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:02.906539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:02.908065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 365/734] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:02.914526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:02.915157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:02.915436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:02.915706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:02.916404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:02.916707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:02.918075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:02.920409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:02.940260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 370/735] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:02.945577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:03.066905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d190-5e87-4023-b7e1-9820d059797d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:03.071418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:03.116405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490ed39-0f53-4b55-81bf-2299b3498a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:03.117084 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ed39-0f53-4b55-81bf-2299b3498a65 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.117303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ed39-0f53-4b55-81bf-2299b3498a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.117570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490ed39-0f53-4b55-81bf-2299b3498a65 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.118395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490ed39-0f53-4b55-81bf-2299b3498a65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:03.118701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490ed39-0f53-4b55-81bf-2299b3498a65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:03.120125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490ed39-0f53-4b55-81bf-2299b3498a65 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:03.124280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abd9c9-45cf-445f-b0a6-0c314cf247cb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:03.129926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:03.141848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 366/736] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:03.144125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32af4e-b536-4411-8f86-ceeb0d3c2f19 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.144481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32af4e-b536-4411-8f86-ceeb0d3c2f19 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.144818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32af4e-b536-4411-8f86-ceeb0d3c2f19 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.146293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 367/737] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:03.147460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32af4e-b536-4411-8f86-ceeb0d3c2f19 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:03.174439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286219c-9663-48db-82e2-19bccd982525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:03.175294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286219c-9663-48db-82e2-19bccd982525 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.175667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286219c-9663-48db-82e2-19bccd982525 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.176036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286219c-9663-48db-82e2-19bccd982525 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.185380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286219c-9663-48db-82e2-19bccd982525 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:03.187186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286219c-9663-48db-82e2-19bccd982525 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9286219c-9663-48db-82e2-19bccd982525 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:03.202170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:03.203404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:03.204466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:03.205666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 371/738] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:03:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:03.205891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41528c-7eb3-49a7-a9d7-54e284782a19 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.206737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41528c-7eb3-49a7-a9d7-54e284782a19 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.207008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41528c-7eb3-49a7-a9d7-54e284782a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.229402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ef41528c-7eb3-49a7-a9d7-54e284782a19 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:03.231228 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ef41528c-7eb3-49a7-a9d7-54e284782a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:03.280184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32af4e-b536-4411-8f86-ceeb0d3c2f19 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:03.318489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 372/739] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 22:03:03.319527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41528c-7eb3-49a7-a9d7-54e284782a19 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:03.322845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:03.323539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.323820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.324196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.399868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:03.401223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:03.402534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:03.439228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:03.442013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41528c-7eb3-49a7-a9d7-54e284782a19 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:03.477893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:03.478463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.478743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.479018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.479812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:03.480114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:03.481543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:03.504698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 373/740] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 28 22:03:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:03.505571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:03.513331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 368/741] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:03 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 22:03:03.514451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:03.607603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e3ffd-134f-411a-ae00-346b08dc7c2b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:03.616341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:03.623188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d54e-e3d0-43f4-b4fe-653f11d6a58c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:03.630504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:03.649416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:03.650039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.650349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.650624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.651318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:03.652678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:03.664607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ef406-0d18-4cb6-8660-54881f13dca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:03.665227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef406-0d18-4cb6-8660-54881f13dca8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.665523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef406-0d18-4cb6-8660-54881f13dca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.665794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef406-0d18-4cb6-8660-54881f13dca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.676503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 374/742] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:03 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:03.676503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:03.745413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ef406-0d18-4cb6-8660-54881f13dca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:03.746939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ef406-0d18-4cb6-8660-54881f13dca8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:03.820092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c121-407a-41b0-b1f6-3f3880b9447d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:03.867381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5833003-7543-4bcd-992e-f936b489e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:03.868041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833003-7543-4bcd-992e-f936b489e86a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.868325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833003-7543-4bcd-992e-f936b489e86a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.868601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833003-7543-4bcd-992e-f936b489e86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.875318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:03.883871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 369/743] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:03 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 22:03:03.885135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca0ce-76e2-4c66-95e6-b27d13ea60be None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.885420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca0ce-76e2-4c66-95e6-b27d13ea60be None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.885757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca0ce-76e2-4c66-95e6-b27d13ea60be None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.888091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5833003-7543-4bcd-992e-f936b489e86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:03.888091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5833003-7543-4bcd-992e-f936b489e86a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:03.891271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 370/744] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:03.892239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca0ce-76e2-4c66-95e6-b27d13ea60be None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a5833003-7543-4bcd-992e-f936b489e86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:03.909336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:03.910470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:03.911554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:03.911554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:03.911554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:03.911554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:03.913158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 375/745] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:03.914554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aded9-3e97-4eaa-963e-85d3d171d3eb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:03.914981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aded9-3e97-4eaa-963e-85d3d171d3eb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:03.915409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aded9-3e97-4eaa-963e-85d3d171d3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:03.939175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7b6aded9-3e97-4eaa-963e-85d3d171d3eb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:03.941172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7b6aded9-3e97-4eaa-963e-85d3d171d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:03.973165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.020708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca0ce-76e2-4c66-95e6-b27d13ea60be None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.029793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 376/746] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:04.030911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aded9-3e97-4eaa-963e-85d3d171d3eb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.058210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.059200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.059689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.060178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.072272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.074072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:04.090409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:04.091343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:04.092214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:04.092214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:04.092214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:04.092214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:04.094498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 371/747] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:04.095695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.142055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aded9-3e97-4eaa-963e-85d3d171d3eb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.152927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.181282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.181903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.182186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.182491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.183187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:04.183494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.184865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.198024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 377/748] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:04.199194 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.213178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45994-776b-488a-9a40-5b957df77165 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.218788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.252704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.254007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.254527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.255005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.255936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.257494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:04.267597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:04.268576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:03:04.269401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:04.272365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 372/749] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:04.273358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.306959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024cedf-e815-4d9c-8fec-930de7cf9df7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.341796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.342453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.342792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.343075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.343773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:04.344079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.345443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.358562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 378/750] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:04.359454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.383581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcfe00-796f-476b-b206-2be6c5dfdcfa None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.400537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.423854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.425692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.426172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.426665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.436159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.438444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.441322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:04.457082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:04.458174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:04.459299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:04.461838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 373/751] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:04.463435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.469065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab125-3eb8-4b47-87e1-4f6773c2b9ae None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.514254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.514254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.514254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.514254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.514672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:04.514672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.514672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.519961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 379/752] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:04.521429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.585656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b180-2e24-4988-bbc3-d3bd07af5d3f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.625413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.626065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.626371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.626654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.634118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.635601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:04.648043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:04.648945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:04.649830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 374/753] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:04.650804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.656936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3953cec-4999-4772-b50c-2ab2363425dd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.692058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.693917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.694637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.695120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.695503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.696323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:04.696794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.698391 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.711285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 380/754] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:04.712204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.714893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.771173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef693dea-bcae-41f3-8c9d-8665f3989630 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.807814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.808431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.808705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.808975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.809654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:04.809955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.811345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.817605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 375/755] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:04.822406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.822543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3c10-53a3-4c76-ba4a-d2418a711ca8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.856493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f630-4567-4acf-9d36-70befb3c1fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.857126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f630-4567-4acf-9d36-70befb3c1fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.857497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f630-4567-4acf-9d36-70befb3c1fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.857841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f630-4567-4acf-9d36-70befb3c1fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.858736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f630-4567-4acf-9d36-70befb3c1fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:04.859046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f630-4567-4acf-9d36-70befb3c1fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.860520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f630-4567-4acf-9d36-70befb3c1fd8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.873004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 381/756] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:04.874036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccfbe1-3de5-4c6a-9235-dcd4072ec1bc None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.878940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccfbe1-3de5-4c6a-9235-dcd4072ec1bc None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.878940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccfbe1-3de5-4c6a-9235-dcd4072ec1bc None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.878940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 382/757] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:04.878940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccfbe1-3de5-4c6a-9235-dcd4072ec1bc None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:04.936546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.944994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9808204-de60-4022-b33b-94d518cd79eb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:04.951997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:04.985116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:04.985736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:04.986016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:04.986336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:04.987097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=92ef4880fa1f413c8f553ebee43d4c1d) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:04.987406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:04.988831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:04.994410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 376/758] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/role_assignments?user.id=92ef4880fa1f413c8f553ebee43d4c1d&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:04.995201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:05.010026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccfbe1-3de5-4c6a-9235-dcd4072ec1bc None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:05.059918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4ab73-0315-4a18-b264-787a87b32717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:05.061076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ab73-0315-4a18-b264-787a87b32717 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.061994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ab73-0315-4a18-b264-787a87b32717 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.062483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ab73-0315-4a18-b264-787a87b32717 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.063413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4ab73-0315-4a18-b264-787a87b32717 None admin] RBAC: Adding query filter params (interface=public, service_id=28e8ac849373454ab4e34d945ff956ac, region_id=RegionOne) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:05.063874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4ab73-0315-4a18-b264-787a87b32717 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:05.066693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4ab73-0315-4a18-b264-787a87b32717 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:05.078929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 383/759] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/endpoints?service_id=28e8ac849373454ab4e34d945ff956ac&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:05.080891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129083-e863-4e83-8cf3-8ded7bf0d31c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.081894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129083-e863-4e83-8cf3-8ded7bf0d31c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.082349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b129083-e863-4e83-8cf3-8ded7bf0d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.105505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7b129083-e863-4e83-8cf3-8ded7bf0d31c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:05.105505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7b129083-e863-4e83-8cf3-8ded7bf0d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:05.125161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b5ccf-0ac5-41ac-ad79-d42d721a5ff6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:05.166689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:05.167323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.167676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.167957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.168757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=61cbae3b43bc49e1a221be07f06a57f6) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:05.169070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:05.171508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:05.177788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 377/760] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:04 2022] GET /identity/v3/role_assignments?user.id=61cbae3b43bc49e1a221be07f06a57f6&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:05.178640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:05.207061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:05.215802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 384/761] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:05.252216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b129083-e863-4e83-8cf3-8ded7bf0d31c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:05.350366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865c60f-5a58-4cfe-8370-4a781672d971 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:05.376649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:05.404725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:05.405443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.405630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.405896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.406596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:05.407980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:05.413488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 378/762] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:05 2022] GET /identity/v3/services => generated 772 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:05.477058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b129083-e863-4e83-8cf3-8ded7bf0d31c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:05.535436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:05.536109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.536392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.536669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.551238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:05.556282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:05.557724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:05.558644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 385/763] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:05.563505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:05.689099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:05.705194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253def1-3062-43b2-8e21-a17c5a70042d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:05.742705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65efe9-4099-42c5-9776-7f4091658ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:05.743327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65efe9-4099-42c5-9776-7f4091658ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.743605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65efe9-4099-42c5-9776-7f4091658ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.743875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65efe9-4099-42c5-9776-7f4091658ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.744593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65efe9-4099-42c5-9776-7f4091658ba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:05.744895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65efe9-4099-42c5-9776-7f4091658ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:05.746364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65efe9-4099-42c5-9776-7f4091658ba4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:05.758205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 379/764] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:05.762623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:05.874382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e38e-ead0-46f4-a9e2-695325369afb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:05.891401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:05.917466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:05.918269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.918562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.918885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.919562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e575-f353-4d0b-a867-35b2b75cbb0e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.919846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e575-f353-4d0b-a867-35b2b75cbb0e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.920120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e575-f353-4d0b-a867-35b2b75cbb0e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.921697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 380/765] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:05.927233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1671e6-3379-409e-ba13-4442c4273ad9 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:05.927506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1671e6-3379-409e-ba13-4442c4273ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:05.927773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1671e6-3379-409e-ba13-4442c4273ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:05.936436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:05.937891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:05.948097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3d1671e6-3379-409e-ba13-4442c4273ad9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:05.949957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3d1671e6-3379-409e-ba13-4442c4273ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:05.960282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:05.961192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:05.962092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:05.962092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:05.962092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:05.962092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:05.962092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 386/766] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:05.967040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:06.033196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 381/767] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:06.058812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1671e6-3379-409e-ba13-4442c4273ad9 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:06.187189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7cf1-f67e-4c55-91e8-a53705bad4a8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:06.202664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:06.237967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1671e6-3379-409e-ba13-4442c4273ad9 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:06.256002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:06.256630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:06.256914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:06.257186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:06.257882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:06.258193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:06.259595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:06.277704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 387/768] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:06.292849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:06.297259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:06.297936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:06.298225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:06.298523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] PATH_INFO: `/v3/services/network` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:06.299167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:06.301139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:06.310832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:06.311860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:06.312682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 382/769] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:06 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:06.323258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:06.336886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:06.412357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71470873-09e1-49d5-856a-fd9f0dfb7e0b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:06.447150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:06.447799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:06.448083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:06.448359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:06.456626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:06.458176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:06.471275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:06.472793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:06.473733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 388/770] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:03:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:06.478631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:06.545542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd980-7805-454f-ae6d-9f496f44b291 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:06.588343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:06.589295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:06.589727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:06.592563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:06.593432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] RBAC: Adding query filter params (name=network) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:06.593883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:06.595452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:06.607257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 383/771] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:06.613470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:06.634568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:06.672145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:06.697780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ffaa-f082-433d-a59b-0e9e112d1975 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:06.762385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:06.762929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:06.763207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:06.763477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:06.764273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:06.764577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:06.766000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:06.803078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 389/772] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:03:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:06.819380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a901080-343f-439a-90d7-b2c75cc8ab40 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:06.827784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:06.873992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:06.874885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:06.875385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:06.875880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:06.876931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] RBAC: Adding query filter params (type=network) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:06.877448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:06.879502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:06.885338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 384/773] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:06.891306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.020757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38ed0-95ef-4628-abfd-ca82b16d0845 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.021452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:07.076358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429129dd-5bb4-443b-86e4-f334986d14fa None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.091284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.092003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.092281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.092605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.109132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:07.110633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:07.119258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:07.129244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:07.130169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:07.131113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:07.131113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:07.131113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:07.131113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:07.131113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 390/774] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:07.138995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.194955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.195597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.195876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.196156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.196912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] RBAC: Adding query filter params (interface=public, service_id=e4a7dff8519648a0b4d639d946989f29, region_id=RegionOne) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:07.197224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:07.202271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:07.208892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 385/775] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:03:06 2022] GET /identity/v3/endpoints?service_id=e4a7dff8519648a0b4d639d946989f29&interface=public®ion_id=RegionOne => generated 194 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:07.219235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.258626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d436a1c-4c4c-484d-93df-ac52e44d3e9c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.307125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b831582-ba95-4d05-a80c-bc3ca404ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.308079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831582-ba95-4d05-a80c-bc3ca404ce4c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.308614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831582-ba95-4d05-a80c-bc3ca404ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.308896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831582-ba95-4d05-a80c-bc3ca404ce4c None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.309584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831582-ba95-4d05-a80c-bc3ca404ce4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:07.309885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831582-ba95-4d05-a80c-bc3ca404ce4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:07.311531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b831582-ba95-4d05-a80c-bc3ca404ce4c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:07.328258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 391/776] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:07.329552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc826c7-5f8c-4fc9-84d5-b81e448a6371 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.329835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc826c7-5f8c-4fc9-84d5-b81e448a6371 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.330106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc826c7-5f8c-4fc9-84d5-b81e448a6371 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.332191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 392/777] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:07.334120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc826c7-5f8c-4fc9-84d5-b81e448a6371 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.353246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ec6d-b5e9-4e88-b198-bacc7495e8a1 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.389009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c10f4-9a37-4886-b004-11e622c7c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.389854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c10f4-9a37-4886-b004-11e622c7c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.390198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c10f4-9a37-4886-b004-11e622c7c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.390564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c10f4-9a37-4886-b004-11e622c7c0d4 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.391429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c10f4-9a37-4886-b004-11e622c7c0d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:07.392918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c10f4-9a37-4886-b004-11e622c7c0d4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:07.395850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:07.406404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 386/778] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:07 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:07.406404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8da1-3b76-4037-aa54-0d85822253e2 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.406404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8da1-3b76-4037-aa54-0d85822253e2 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.406404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8da1-3b76-4037-aa54-0d85822253e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.422609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:07.430560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-44bf8da1-3b76-4037-aa54-0d85822253e2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:07.431802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-44bf8da1-3b76-4037-aa54-0d85822253e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:07.523376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc826c7-5f8c-4fc9-84d5-b81e448a6371 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.571298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 387/779] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:07.572964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.573635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.573918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.574182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.577944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64716460-e0b7-4a35-9027-0a5443ef9295 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.578205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64716460-e0b7-4a35-9027-0a5443ef9295 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.578554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64716460-e0b7-4a35-9027-0a5443ef9295 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.580189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 388/780] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:07.582408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:07.584375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:07.591160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdea19-f87c-460b-9aff-e26c31b07df5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.591441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdea19-f87c-460b-9aff-e26c31b07df5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.591713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdea19-f87c-460b-9aff-e26c31b07df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:07.596934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:07.597814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:07.598803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 393/781] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:07.603933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.618621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-72cdea19-f87c-460b-9aff-e26c31b07df5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:07.619802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-72cdea19-f87c-460b-9aff-e26c31b07df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:07.715036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 389/782] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:07.720405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdea19-f87c-460b-9aff-e26c31b07df5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.722387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ebd41-2827-43ec-9bf2-0bd6154b8cd8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.751867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:07.776070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.777246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.777724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.778189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.779254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:07.779837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:07.781552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:07.790720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:07.800712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 394/783] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:07.801976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.843860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdea19-f87c-460b-9aff-e26c31b07df5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.882223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.882909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.883187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.883685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.894952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:07.901095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:07.902050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:07.902944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:07.907203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 390/784] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:07.908013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:07.932552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622b73b-52a9-44f7-9871-352f33099d25 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:07.981015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:07.982033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:07.982601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:07.983322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:07.998176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:08.005772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:08.006763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:03:08.007614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:08.011086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 395/785] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:08.012315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.032015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc88fd1-3708-4ff7-9c9d-78754eee8373 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.054245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:08.059430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:08.072481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.073163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.073447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.073727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/cf0b530da35f445d8241c16d8f51b16b/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.075758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=cf0b530da35f445d8241c16d8f51b16b, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.077188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.090183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 391/786] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:03:07 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/cf0b530da35f445d8241c16d8f51b16b/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:03:08.091011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.146011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7918-668a-4203-bc07-033c54d4b729 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.189603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940fbbe-4968-42c6-8901-01fc2c0f2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.190932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fbbe-4968-42c6-8901-01fc2c0f2533 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.191614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fbbe-4968-42c6-8901-01fc2c0f2533 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.191969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fbbe-4968-42c6-8901-01fc2c0f2533 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.192849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940fbbe-4968-42c6-8901-01fc2c0f2533 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:08.193506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940fbbe-4968-42c6-8901-01fc2c0f2533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.196206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940fbbe-4968-42c6-8901-01fc2c0f2533 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.209881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 396/787] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:08.212218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271983-0331-41ed-8067-448c57298f34 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.212585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271983-0331-41ed-8067-448c57298f34 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.212930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271983-0331-41ed-8067-448c57298f34 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.218325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 397/788] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:08.219472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22271983-0331-41ed-8067-448c57298f34 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.236996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7e43-28c6-437a-bcea-1c605c7920e6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.281463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d179-915e-45bf-b942-bf64c9da28f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.282467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d179-915e-45bf-b942-bf64c9da28f2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.282892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d179-915e-45bf-b942-bf64c9da28f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.283302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d179-915e-45bf-b942-bf64c9da28f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.284196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d179-915e-45bf-b942-bf64c9da28f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:08.285139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d179-915e-45bf-b942-bf64c9da28f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.286705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d179-915e-45bf-b942-bf64c9da28f2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.302067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 392/789] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:08.303930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9b0b-3613-4cdf-bb40-33f3e492871d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.304384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9b0b-3613-4cdf-bb40-33f3e492871d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.304801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9b0b-3613-4cdf-bb40-33f3e492871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.329277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-6d9b9b0b-3613-4cdf-bb40-33f3e492871d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:08.330574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6d9b9b0b-3613-4cdf-bb40-33f3e492871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:08.368372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:08.370894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:08.374632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22271983-0331-41ed-8067-448c57298f34 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.418226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.419182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.419606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.420063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.433058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.434942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:08.451738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:08.452863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:08.453771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:08.453771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:08.453771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:08.453771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:08.456019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 398/790] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:08.457095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.542316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 393/791] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:08.543781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9b0b-3613-4cdf-bb40-33f3e492871d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.572494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397386b-a6b2-4913-bcd3-527f928ca750 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.617641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.619342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.619843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.620599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.636950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.638445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:08.654392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:08.655320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:08.656220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:08.656220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:08.656220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:08.656220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:08.656220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 399/792] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:08.656904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.661139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:08.681446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9b0b-3613-4cdf-bb40-33f3e492871d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.728050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.728627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.728907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.729180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.729876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:08.730178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.731592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.748513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 394/793] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:08.749128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.778288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ab59b-c66f-4dd0-968c-dc4b9952d080 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.790636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:08.821917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.822844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.823352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.823802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.824666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.826271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:08.836248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:08.837379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 22:03:08.838450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:08.845897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 400/794] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:08.847692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.876064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed52422-2dd8-4f5f-9bac-0b04e3579455 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:08.923926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:08.925257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:08.925825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:08.928451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:08.929263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:08.929676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:08.931176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:08.931708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:08.944130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 395/795] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:08.945231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:08.981738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c374557-4638-49b4-ab8a-8bf9f9c9f868 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.027728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.029123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.029547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.029978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.041382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.043530 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.047816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:09.058393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b2797-b0ef-4850-b402-3409d69876b7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:09.060270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:09.061356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:03:09.062521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:09.070476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 401/796] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:09.071422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.106634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.107324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.107721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.108065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.108921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:09.109321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.110835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.120840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 396/797] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 28 22:03:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:09.121972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.199069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13c186-c82b-4c2b-8354-fae18aeecc39 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.234776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:09.245727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.246340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74452243-4ac3-405a-87d2-914f2da81089 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.246468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.246663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.246906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.257108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.259281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:09.275319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:09.276348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:09.277317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:09.278439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 402/798] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:09.278652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.289712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.290534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.290821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.291093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.292024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:09.292334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.294002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.313700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 397/799] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:09.314659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.336471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:09.421893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112da22-1184-42cf-9431-e02b44d6457b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.426563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caff6-a053-424d-926b-b493b9e3a618 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.464694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.465103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.465423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.465699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.466395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:09.466698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.468062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.471464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.472258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.472677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.473090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.473339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 403/800] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:09.474125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.474380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:09.474890 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.476447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.504587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 398/801] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:09.505717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.533801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:09.583255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:09.585214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c070-5e94-4b5a-915e-ea879a449c91 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.617451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e5b2-a00f-4ff2-8345-b28b7b6e73e4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.620590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.621234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.621510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.621778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.634076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.635539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:09.650311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:09.651256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:09.652181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:09.652181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:09.652181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:09.652181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:09.655528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f105181-06ae-4a12-a42b-8ebb54386af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.656027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 404/802] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:09.656230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f105181-06ae-4a12-a42b-8ebb54386af1 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.656572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f105181-06ae-4a12-a42b-8ebb54386af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.656844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.656940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f105181-06ae-4a12-a42b-8ebb54386af1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.657593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f105181-06ae-4a12-a42b-8ebb54386af1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.658989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f105181-06ae-4a12-a42b-8ebb54386af1 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.683253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 399/803] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:09.685247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f3361-3a59-4aca-b43b-720544846e33 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.685745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f3361-3a59-4aca-b43b-720544846e33 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.686226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f3361-3a59-4aca-b43b-720544846e33 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.687768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 400/804] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:09.688747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f3361-3a59-4aca-b43b-720544846e33 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.798178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc6c4-a856-4668-8afe-c9832eecce70 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.802467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:09.847932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f3361-3a59-4aca-b43b-720544846e33 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:09.855225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e62940-a094-4ecc-b1a9-ba2f7939d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.856548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62940-a094-4ecc-b1a9-ba2f7939d0eb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.857079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62940-a094-4ecc-b1a9-ba2f7939d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.857423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62940-a094-4ecc-b1a9-ba2f7939d0eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.872389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e62940-a094-4ecc-b1a9-ba2f7939d0eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.873842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e62940-a094-4ecc-b1a9-ba2f7939d0eb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.880993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-63e62940-a094-4ecc-b1a9-ba2f7939d0eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:09.893099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:09.894092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:09.895030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:09.895030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:09.895030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:09.895030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:09.895030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 405/805] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:09.896108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c3080-851b-4792-b303-b9dfb18f92de None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.896108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c3080-851b-4792-b303-b9dfb18f92de None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.896108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c3080-851b-4792-b303-b9dfb18f92de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.906191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:09.908443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:09.908443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:09.908443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:09.908443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:09.908443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:09.909820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:09.921516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e33c3080-851b-4792-b303-b9dfb18f92de None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:09.922762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e33c3080-851b-4792-b303-b9dfb18f92de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:09.923350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 401/806] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:09.924250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:09.993226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 406/807] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:09.994083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c3080-851b-4792-b303-b9dfb18f92de None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.034173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41aee-1d54-499a-8e20-f97884b237dc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.071560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.072111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.072393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.072672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.073476 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:10.073788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.075355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.081769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:10.089526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 402/808] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:10.095052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.098931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c3080-851b-4792-b303-b9dfb18f92de None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.136252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.136906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.137189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.137461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.145895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.147686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:10.163128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:10.164093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:10.165011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 407/809] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:10.165547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.166609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:10.213062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1653b6-1288-4eb1-89b9-ac6dcf094f7f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.251677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.252329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.252637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.253183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.253814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.255231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:10.264242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:10.265330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:10.266213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 403/810] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:10.267075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.294564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6650-1125-4b55-8035-9d76d8c61e94 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.336731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374abea-6ba8-43eb-b370-e48b84ebbe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.337372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374abea-6ba8-43eb-b370-e48b84ebbe06 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.337653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374abea-6ba8-43eb-b370-e48b84ebbe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.337924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374abea-6ba8-43eb-b370-e48b84ebbe06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.344996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374abea-6ba8-43eb-b370-e48b84ebbe06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.346209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374abea-6ba8-43eb-b370-e48b84ebbe06 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a374abea-6ba8-43eb-b370-e48b84ebbe06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:10.357711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:10.358828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:10.359744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:10.360231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1819a0-97cb-46da-8eab-0394b71f8308 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.360231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1819a0-97cb-46da-8eab-0394b71f8308 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.361097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1819a0-97cb-46da-8eab-0394b71f8308 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.361899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 409/812] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:10.362494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1819a0-97cb-46da-8eab-0394b71f8308 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.372567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:10.389874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f07e-18a9-4749-b30a-daeba8a86be4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.401621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:10.431494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba03879-3483-45ce-b324-9353a850a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.432929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03879-3483-45ce-b324-9353a850a41a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.433468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03879-3483-45ce-b324-9353a850a41a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.433894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03879-3483-45ce-b324-9353a850a41a None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.435475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba03879-3483-45ce-b324-9353a850a41a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:10.436212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba03879-3483-45ce-b324-9353a850a41a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.437839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba03879-3483-45ce-b324-9353a850a41a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.460002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 404/813] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:10.460002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1f6e-93ee-4b52-8584-c5ce47c013b1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.460002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1f6e-93ee-4b52-8584-c5ce47c013b1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.460002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1f6e-93ee-4b52-8584-c5ce47c013b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.474734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c9ec1f6e-93ee-4b52-8584-c5ce47c013b1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:10.475940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c9ec1f6e-93ee-4b52-8584-c5ce47c013b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:10.482319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1819a0-97cb-46da-8eab-0394b71f8308 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.521016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.521649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.521917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.522186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.522892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] RBAC: Adding query filter params (name=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:10.523198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.524556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.529244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 410/814] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:10.529829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.546943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 405/815] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:10.548063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1f6e-93ee-4b52-8584-c5ce47c013b1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.621979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:10.652718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:10.655933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14eb3-974d-4561-81ad-1b8bf5cab030 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.656846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1f6e-93ee-4b52-8584-c5ce47c013b1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.691811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.692420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.692700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.692975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.693714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:10.694018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.694293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.694969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.695250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.695473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.695570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/92ef4880fa1f413c8f553ebee43d4c1d/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.697867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=92ef4880fa1f413c8f553ebee43d4c1d, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.699330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.708395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 411/816] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:10.709186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.715573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 406/817] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:03:10 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/92ef4880fa1f413c8f553ebee43d4c1d/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:03:10.716629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.841319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a7bd-5668-4414-a6e0-4db9eea4da80 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.859955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2bd2-504a-4a97-8dcf-bc0cfafabaeb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:10.894940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.896511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.896795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.897070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.905037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:10.912849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:10.913746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:10.916946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:10.916946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:10.916946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:10.916946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] RBAC: Adding query filter params (type=network) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:10.916946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:10.917318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:10.917871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:10.918853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:10.919707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 407/818] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:10.920945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.926345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 412/819] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:10.928699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:10.952808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:11.033566 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b611f-58f2-49d6-a847-ffd46d890fdd None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:11.065671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeeef3-0d5b-4a26-aebb-183af3a6b206 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:11.070800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:11.071786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.072301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.072790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/61cbae3b43bc49e1a221be07f06a57f6/roles/d897affd236f4dcc9e85a147bfe9d820` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.092575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=61cbae3b43bc49e1a221be07f06a57f6, role_id=d897affd236f4dcc9e85a147bfe9d820)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:11.095247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:11.111467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:11.112842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.113193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.113539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.114410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:11.114727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:11.116172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:11.119027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 408/820] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:03:10 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/61cbae3b43bc49e1a221be07f06a57f6/roles/d897affd236f4dcc9e85a147bfe9d820 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:03:11.120036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:11.131534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 413/821] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:11.134934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:11.252179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:11.263662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:11.327900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c53b4d-a811-49f0-aa6d-16875e778e52 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:11.335482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091f76-dd6e-4e6f-9d65-39f7b154c61d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:11.381407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:11.382059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.382357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.382635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.383356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:11.384945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:11.386148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:11.387043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.387524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.387999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.400651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:11.402515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:11.409010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 409/822] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:11.421220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:11.422253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:11.423340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:11.423340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:11.423340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:11.423340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:11.434583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 414/823] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:11.435807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:11.582714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9ae6-3669-464f-9cb7-c3dc0c28a9a7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:11.611563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:11.635484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc998eb7-ef73-4c47-801f-50b0f772c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:11.636113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc998eb7-ef73-4c47-801f-50b0f772c605 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.636389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc998eb7-ef73-4c47-801f-50b0f772c605 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.636658 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc998eb7-ef73-4c47-801f-50b0f772c605 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.637368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc998eb7-ef73-4c47-801f-50b0f772c605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:11.637670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc998eb7-ef73-4c47-801f-50b0f772c605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:11.639086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc998eb7-ef73-4c47-801f-50b0f772c605 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:11.660412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 410/824] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:11.666268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:11.787712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe610e-ed4e-4a60-8d1f-4f03589e1742 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:11.798415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:11.831887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:11.832535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.832862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.833085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.849459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d674-350f-43e1-9443-747abec1605f None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.849459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d674-350f-43e1-9443-747abec1605f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.849459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3d674-350f-43e1-9443-747abec1605f None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.850274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 411/825] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:11.851594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:11.853263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:11.854975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83ef6b-fd5b-4664-960a-bbbfed75d346 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:11.855255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83ef6b-fd5b-4664-960a-bbbfed75d346 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:11.855527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83ef6b-fd5b-4664-960a-bbbfed75d346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:11.871119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:11.872129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:11.873092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 415/826] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:03:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:11.874304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8c83ef6b-fd5b-4664-960a-bbbfed75d346 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:11.875246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8c83ef6b-fd5b-4664-960a-bbbfed75d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:11.885197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:11.978291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 412/827] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:11.999099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83ef6b-fd5b-4664-960a-bbbfed75d346 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:12.040088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d115db-7098-44c7-9148-71bb4cf8e64f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:12.078536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:12.079236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.079515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.079786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.080886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:12.080999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:12.082495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:12.104423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 416/828] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:03:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:12.109864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:12.140762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83ef6b-fd5b-4664-960a-bbbfed75d346 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:12.142593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:12.153592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:12.180452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:12.181459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.182034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.182538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.183369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:12.184950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:12.194937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:12.195919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:12.196857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:12.199699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 413/829] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:12.210295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:12.226932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad78b4-296c-4c68-b788-348fce719c73 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:12.272069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:12.272701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.273117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.273413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.319258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb0121-c48a-49eb-8a58-1d369c834fc8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:12.355791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:12.357482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:12.361087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:12.361719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.362055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.362350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.363027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:12.363327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:12.364672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:12.371042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 414/830] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:12.376589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:12.402287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:12.427942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:12.491320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa767374-a468-412b-91d3-6c45e1c3f48a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:12.510304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 417/831] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:12.511215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:12.538947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:12.539973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.540408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.541105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.542513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:12.543106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:12.545047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:12.566859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 415/832] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:12.631854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01c5a-7404-42af-a978-5b80c38c12e6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:12.662100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:12.673658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:12.674332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.674772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.675047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.686536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:12.687988 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:12.705569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:12.707133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:12.708474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:12.708474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:12.708474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:12.708474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:12.708474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 418/833] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:12.713307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:12.822111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc2424-36b6-4a5a-b54b-bcb2a217fc1f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:12.823710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:12.858616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ad279-ef3e-44b0-a208-ed8914733365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:12.859374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ad279-ef3e-44b0-a208-ed8914733365 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.859564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ad279-ef3e-44b0-a208-ed8914733365 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.859827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ad279-ef3e-44b0-a208-ed8914733365 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.860527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ad279-ef3e-44b0-a208-ed8914733365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:12.860826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ad279-ef3e-44b0-a208-ed8914733365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:12.862888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ad279-ef3e-44b0-a208-ed8914733365 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:12.875399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 416/834] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:12.881519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:12.897511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4f47-f6a3-4f23-aa37-fdcf8fbc6a3e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.897699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4f47-f6a3-4f23-aa37-fdcf8fbc6a3e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.897950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4f47-f6a3-4f23-aa37-fdcf8fbc6a3e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.899558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 417/835] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:12.904292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969481b0-0510-4189-ab14-f16833d5f10a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:12.904575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969481b0-0510-4189-ab14-f16833d5f10a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:12.904849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969481b0-0510-4189-ab14-f16833d5f10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:12.922970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-969481b0-0510-4189-ab14-f16833d5f10a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:12.924183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-969481b0-0510-4189-ab14-f16833d5f10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:12.993013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03a9c9-41e5-4d8c-93a5-d60f8a6fe959 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.005204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 418/836] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:13.027171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969481b0-0510-4189-ab14-f16833d5f10a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.029178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.029986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.030402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.030680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.037619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:13.039407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:13.055713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:13.056655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:13.057562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:13.060049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 419/837] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:13.066828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.110736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:13.137191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:13.157407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969481b0-0510-4189-ab14-f16833d5f10a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.187584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0ce2-4f19-42a8-9d89-dda96ac47914 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.195300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.195974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.196453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.196775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.207718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:13.212783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:13.214428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:13.215301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 419/838] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:13.228568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.236430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.237748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.238088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.238448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.239308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:13.239680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:13.241220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:13.254492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 420/839] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:13.260058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.338661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8487d-2d78-4f64-b751-26d4f1eb0609 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.358044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:13.361607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce87ef-a508-401e-9db7-916bf86469df None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.378765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.379703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.380282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.380804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.381771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:13.382551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:13.384268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:13.398917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 420/840] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:13.399803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.402938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d96b1-4d1c-462c-9b2d-d80350ab5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.403546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d96b1-4d1c-462c-9b2d-d80350ab5b4f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.403821 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d96b1-4d1c-462c-9b2d-d80350ab5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.404088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d96b1-4d1c-462c-9b2d-d80350ab5b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.404864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d96b1-4d1c-462c-9b2d-d80350ab5b4f None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=cf0b530da35f445d8241c16d8f51b16b) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:13.405163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d96b1-4d1c-462c-9b2d-d80350ab5b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:13.406619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d96b1-4d1c-462c-9b2d-d80350ab5b4f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:13.418602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 421/841] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/role_assignments?user.id=cf0b530da35f445d8241c16d8f51b16b&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:13.422671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:13.504104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fe5e1-a921-4ef8-89a0-e415f2919c07 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.504467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fe5e1-a921-4ef8-89a0-e415f2919c07 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.504668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fe5e1-a921-4ef8-89a0-e415f2919c07 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.506097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 422/842] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:13.511543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f427-ba53-43ec-965f-aae2102675fd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.511817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f427-ba53-43ec-965f-aae2102675fd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.512092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f427-ba53-43ec-965f-aae2102675fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.527587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a527a7c-aed3-4500-b5d7-1e49384094e0 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.535549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a095f427-ba53-43ec-965f-aae2102675fd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:13.537471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a095f427-ba53-43ec-965f-aae2102675fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:13.571963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.572671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.573047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.573325 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.585589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:13.587068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:13.603079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:13.604023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:13.604913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:13.604913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:13.604913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:13.604913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:13.604913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 421/843] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:13.609973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.622374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 423/844] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:13.646144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f427-ba53-43ec-965f-aae2102675fd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.689570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:13.730423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce192f9-a694-45b5-b53c-6788e79c39ca None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.761187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:13.773412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.774048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.775603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f427-ba53-43ec-965f-aae2102675fd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.777298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.777589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.778323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:13.778634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:13.780915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:13.798172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 422/845] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:13.803617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.829597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.830259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.830672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.831361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:13.842556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:13.847529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:13.848492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:13.849344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 424/846] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:13.854791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:13.945618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b71f-d55e-42a5-bb90-027f6e217e9b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.963422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb21043-1d10-499b-9e83-2b00cee7fd9c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:13.981901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:13.992649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:13.992968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:13.993235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:13.993511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.001170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.002463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.010404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.011404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.012039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.013132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.014815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:14.015565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.017496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:14.021949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:14.022951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 22:03:14.023896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:14.030192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 425/848] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:14.030762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 423/848] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:14.031773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.035936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.052342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:14.151167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12611008-cb53-4c98-b1b7-cc913877d949 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.179596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ffd39-bacf-4788-91bd-8bdf7a435ddd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.187783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.188419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.188696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.189237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.200358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.201736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:14.217291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:14.218456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:14.219448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:14.219448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:14.219448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:14.219448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:14.223678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 424/849] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:14.224592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.225244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.226056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.226509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.226926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.228169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:14.229592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.231222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.252140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 426/850] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:14.257737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.281471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:14.345712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e99a22-8d3a-4c46-93d7-0d386dc2af8a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.356571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:14.384586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.385611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.385895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.386169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.387163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:14.387469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.389583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.396890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bf464-61b9-4e6d-9708-50a1daea9fd3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.406392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 425/851] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:14.411558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.463707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.465376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.466101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.466842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.569727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:14.573784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.575578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.577103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996248a-ab66-4964-8395-880bce076b28 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.617475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.618119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.618439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.618708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.626942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.629226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:14.642216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:14.643878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:14.644821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 426/852] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:14.651167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.662711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:14.710302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 427/853] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 22:03:14.711395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.775709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8781f-920e-49b8-a462-f47b5b50455b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.809043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274f4bb-aa75-44e6-8879-ab67aa9ad0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.809660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f4bb-aa75-44e6-8879-ab67aa9ad0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.809938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f4bb-aa75-44e6-8879-ab67aa9ad0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.810210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f4bb-aa75-44e6-8879-ab67aa9ad0f9 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.811016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274f4bb-aa75-44e6-8879-ab67aa9ad0f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:14.811319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274f4bb-aa75-44e6-8879-ab67aa9ad0f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.812720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274f4bb-aa75-44e6-8879-ab67aa9ad0f9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.825422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ed0f-0772-43c0-adc5-30197147ffed None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.831347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 427/854] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:14.832529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4e815-8192-43cd-bb6d-17dee9e720e0 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.832808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4e815-8192-43cd-bb6d-17dee9e720e0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.833078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4e815-8192-43cd-bb6d-17dee9e720e0 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.834563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 428/855] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:14.836841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4e815-8192-43cd-bb6d-17dee9e720e0 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:14.855128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:14.867169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807867-42f5-4f2c-8973-e95241c5c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.868018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807867-42f5-4f2c-8973-e95241c5c689 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.868439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807867-42f5-4f2c-8973-e95241c5c689 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.868863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807867-42f5-4f2c-8973-e95241c5c689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.879834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807867-42f5-4f2c-8973-e95241c5c689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:14.881256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807867-42f5-4f2c-8973-e95241c5c689 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-73807867-42f5-4f2c-8973-e95241c5c689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:14.896202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:14.897120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:14.898651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:14.898651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:14.898651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:14.898651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:14.898651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 428/856] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:14.898955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878c88-c676-4f28-abe3-f7cce0caf5c4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.899153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878c88-c676-4f28-abe3-f7cce0caf5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.899362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878c88-c676-4f28-abe3-f7cce0caf5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.916426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9b878c88-c676-4f28-abe3-f7cce0caf5c4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:14.917579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9b878c88-c676-4f28-abe3-f7cce0caf5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:14.937681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:14.952577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4e815-8192-43cd-bb6d-17dee9e720e0 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:14.989301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:14.989931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:14.990290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:14.990569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:14.999925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 429/857] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:15.007570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b878c88-c676-4f28-abe3-f7cce0caf5c4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.063346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.064705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.084065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.128926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b878c88-c676-4f28-abe3-f7cce0caf5c4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.165689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.166332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.166612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.166880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.167582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:15.167880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.169226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.187827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 429/858] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:15.187827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.188083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 430/859] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:15.188083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.204738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.295034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265d741-1352-4d3b-a022-1b30e66e0a4b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.295477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70dfcb-e282-4eb5-b95a-8c54973676be None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.312964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.330238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.330968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.331204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.331470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.333842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.334501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.334775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.335044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.335722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.337075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.343246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.344889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.356124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 430/860] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:15 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:15.357135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:15.360566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:15.361469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:15.363039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:15.363039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:15.363039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:15.363039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:15.367065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 431/861] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:15.368029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.488731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c3a0f-9735-4de5-82b1-4065438bc2f4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.490961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.492836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbec320-6fe5-429f-8cfa-fc99a5ebf131 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.529740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb771a0-a814-4ab4-842d-d02f2b20f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.530089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb771a0-a814-4ab4-842d-d02f2b20f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.530496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb771a0-a814-4ab4-842d-d02f2b20f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.530872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb771a0-a814-4ab4-842d-d02f2b20f3d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.532327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb771a0-a814-4ab4-842d-d02f2b20f3d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:15.532511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb771a0-a814-4ab4-842d-d02f2b20f3d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.534286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb771a0-a814-4ab4-842d-d02f2b20f3d5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.538953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503752a4-945b-437c-848e-6a8ad7d709d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.539791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503752a4-945b-437c-848e-6a8ad7d709d5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.540208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503752a4-945b-437c-848e-6a8ad7d709d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.540618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503752a4-945b-437c-848e-6a8ad7d709d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.547875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 432/862] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:15.548628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503752a4-945b-437c-848e-6a8ad7d709d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.549408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93c38-0e7e-4056-a6f8-3eabc22ef053 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.549816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93c38-0e7e-4056-a6f8-3eabc22ef053 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.550186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93c38-0e7e-4056-a6f8-3eabc22ef053 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.550454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503752a4-945b-437c-848e-6a8ad7d709d5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.551744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 433/863] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:15.553631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93c38-0e7e-4056-a6f8-3eabc22ef053 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-503752a4-945b-437c-848e-6a8ad7d709d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:15.564547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:15.566210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:15.567253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 431/864] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:15.567848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b2fca-d76d-4c51-8459-f9f381717132 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.567848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b2fca-d76d-4c51-8459-f9f381717132 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.568004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b2fca-d76d-4c51-8459-f9f381717132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.590451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-171b2fca-d76d-4c51-8459-f9f381717132 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:15.592621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-171b2fca-d76d-4c51-8459-f9f381717132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:15.621444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.667405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 432/865] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:15.668257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b2fca-d76d-4c51-8459-f9f381717132 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.670775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93c38-0e7e-4056-a6f8-3eabc22ef053 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.702354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.712994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.713636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.713912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.714179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.721664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.723032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:15.734294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:15.735220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:15.736098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 434/866] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:15.736583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.786999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b2fca-d76d-4c51-8459-f9f381717132 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.824765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.825390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.825665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.825936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.826699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:15.827002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.828670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.845729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 433/867] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:15.845729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.846006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad063e4-a563-4bca-9f69-31f9842e2c80 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.872840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.884182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.884818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.885276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.885548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:15.886163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:15.887558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:15.896440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:15.897406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:15.898270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 435/868] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:15.899557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:15.950028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:15.962633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e829d4-226d-4b0a-af0e-ddd5a7a07fe4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:15.997882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:15.998889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:15.999473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:15.999815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:16.000551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:16.000851 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:16.002148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04dc1e-463d-49d3-81eb-ccdb4fbf185d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:16.002475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:16.019883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 434/869] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:16.019883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:16.043131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:16.043748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:16.044027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:16.044298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:16.045074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=92ef4880fa1f413c8f553ebee43d4c1d) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:16.045383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:16.046857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:16.053286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 436/870] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:15 2022] GET /identity/v3/role_assignments?user.id=92ef4880fa1f413c8f553ebee43d4c1d&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:16.055712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:16.130126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:16.159994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbef1-9605-4369-87d8-3cedc7ed3c1a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:16.198889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:16.199909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:16.200393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:16.200913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:16.201803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:16.201980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f045c2-3ec8-4e0b-85cd-1a6846b95a34 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:16.202516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:16.204098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:16.212170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 435/871] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:16.217763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:16.219257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:16.247474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d6486-e67f-46b0-b765-0475c516a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:16.248141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6486-e67f-46b0-b765-0475c516a410 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:16.248424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6486-e67f-46b0-b765-0475c516a410 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:16.248693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6486-e67f-46b0-b765-0475c516a410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:16.249470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d6486-e67f-46b0-b765-0475c516a410 None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=61cbae3b43bc49e1a221be07f06a57f6) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:16.250493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d6486-e67f-46b0-b765-0475c516a410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:16.252447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d6486-e67f-46b0-b765-0475c516a410 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:16.260587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 437/872] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:16 2022] GET /identity/v3/role_assignments?user.id=61cbae3b43bc49e1a221be07f06a57f6&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:16.345127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a721b-d2d5-4c8f-9fc9-00c8c7eea3b4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:16.383487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433828f2-24b4-4b7e-8e13-adaec66fddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:16.384353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433828f2-24b4-4b7e-8e13-adaec66fddf9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:16.384783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433828f2-24b4-4b7e-8e13-adaec66fddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:16.385219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433828f2-24b4-4b7e-8e13-adaec66fddf9 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:16.386079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433828f2-24b4-4b7e-8e13-adaec66fddf9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:16.386607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433828f2-24b4-4b7e-8e13-adaec66fddf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:16.388154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433828f2-24b4-4b7e-8e13-adaec66fddf9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:16.394843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 436/873] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:17.464714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432820-83d6-4d76-afda-1609420d9d46 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:17.465748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432820-83d6-4d76-afda-1609420d9d46 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:17.466273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432820-83d6-4d76-afda-1609420d9d46 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:17.468293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 438/874] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:17.474798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca48e-dc25-4b9e-867c-e5afc790382d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:17.475681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca48e-dc25-4b9e-867c-e5afc790382d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:17.476158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca48e-dc25-4b9e-867c-e5afc790382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:17.494506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c7dca48e-dc25-4b9e-867c-e5afc790382d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:17.496008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c7dca48e-dc25-4b9e-867c-e5afc790382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:17.499428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:17.570764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 437/875] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:17.594684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a432820-83d6-4d76-afda-1609420d9d46 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:17.699750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a432820-83d6-4d76-afda-1609420d9d46 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:17.738279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:17.738860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:17.739143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:17.739416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:17.740037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:17.741395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:17.750593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:17.751572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:17.753233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 439/876] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:17.758588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dca48e-dc25-4b9e-867c-e5afc790382d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:17.862357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dca48e-dc25-4b9e-867c-e5afc790382d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:17.897132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:17.897753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:17.898032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:17.898337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:17.899017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:17.899366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:17.900743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:17.909467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 438/877] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:17.912062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:17.959099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.020269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b3859-7a14-4ef7-94e4-d0672d2217aa None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.055982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:18.056595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.056873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.057142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.057819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:18.058118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:18.059519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:18.069475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 440/878] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:18.070925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:18.075654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.191607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a507f2-fd28-41c9-bfec-cfbc9ff3ce75 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.227163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992d612-1a7a-4745-b981-d0015e0c90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:18.228169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992d612-1a7a-4745-b981-d0015e0c90fa None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.228661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992d612-1a7a-4745-b981-d0015e0c90fa None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.229158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992d612-1a7a-4745-b981-d0015e0c90fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.230217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992d612-1a7a-4745-b981-d0015e0c90fa None admin] RBAC: Adding query filter params (interface=public, service_id=2b681c1c00e5401b9b10076cdd4280b0, region_id=RegionOne) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:18.230753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992d612-1a7a-4745-b981-d0015e0c90fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:18.232315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992d612-1a7a-4745-b981-d0015e0c90fa None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:18.238666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 439/879] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:03:18 2022] GET /identity/v3/endpoints?service_id=2b681c1c00e5401b9b10076cdd4280b0&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:18.243952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:18.267320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee6ae-2efe-40fd-88d2-edfee1e41916 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.268553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee6ae-2efe-40fd-88d2-edfee1e41916 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.269029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee6ae-2efe-40fd-88d2-edfee1e41916 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.270965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 440/880] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:18.275960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215bc1-55ad-4b8d-a2a9-2677505d6aa0 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.276467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215bc1-55ad-4b8d-a2a9-2677505d6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.277435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215bc1-55ad-4b8d-a2a9-2677505d6aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.297223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-cb215bc1-55ad-4b8d-a2a9-2677505d6aa0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:18.298753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cb215bc1-55ad-4b8d-a2a9-2677505d6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:18.371728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf455-b7a6-45b0-8899-ad5bba8763af None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.372911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.380063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 441/881] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:18.380952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.382489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a2f82-6cbd-46ab-924e-99d84355d598 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.382989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a2f82-6cbd-46ab-924e-99d84355d598 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.383259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a2f82-6cbd-46ab-924e-99d84355d598 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.386398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 442/882] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:18.390357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10f4d-04ee-4636-bd2d-5a5443cfdb59 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.390792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10f4d-04ee-4636-bd2d-5a5443cfdb59 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.391225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10f4d-04ee-4636-bd2d-5a5443cfdb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.410673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-75d10f4d-04ee-4636-bd2d-5a5443cfdb59 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:18.412136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-75d10f4d-04ee-4636-bd2d-5a5443cfdb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:18.418602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:18.419338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.419684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.420027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.421104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:18.422879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:18.428904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 441/883] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:18 2022] GET /identity/v3/services => generated 1011 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:03:18.431083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:18.502206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 443/884] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:18.502206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a38541-efce-4b22-9d67-ff49ea642645 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.502206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a38541-efce-4b22-9d67-ff49ea642645 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.502206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a38541-efce-4b22-9d67-ff49ea642645 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.502206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 444/885] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:18.504942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526caf9-e902-4774-8fd3-94bdffb43155 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.505416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526caf9-e902-4774-8fd3-94bdffb43155 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.505842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526caf9-e902-4774-8fd3-94bdffb43155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.526027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c526caf9-e902-4774-8fd3-94bdffb43155 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:18.527377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c526caf9-e902-4774-8fd3-94bdffb43155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:18.570649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebe25d-6d56-4088-8458-b049e762a248 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.607679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 445/886] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:18.608532 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526caf9-e902-4774-8fd3-94bdffb43155 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:18.613092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:18.613092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.613369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.613508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.614133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:18.615609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:18.630284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:18.631363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:18.632223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 442/887] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:18.633037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:18.668518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.671460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.711967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526caf9-e902-4774-8fd3-94bdffb43155 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.742984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ecb02-7452-420d-bf5b-038b3f25a7cd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.750157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:18.750836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.751117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.751394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.762147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:18.767144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:18.768931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:18.770015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:18.773847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 446/888] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 28 22:03:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:18.774792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:18.786521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:18.787214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.787520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.787845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.788827 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:18.789920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:18.806339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 443/889] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:18 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:18.807494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:18.921757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853ae3-d6eb-4b1e-8f37-34ec77698815 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.935634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.948762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:18.953541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9faaf3-6686-47a1-8bc2-7c9af643ea9b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:18.980422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:18.981594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:18.981879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:18.982346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:18.983026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:18.983333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:18.984713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:18.994265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 447/890] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:18.997133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:19.002410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:19.003312 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:19.003595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:19.003868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:19.004600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:19.004899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:19.006293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:19.017407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 444/891] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 28 22:03:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:19.023555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:19.130970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ab15-e1c2-4232-986a-aa1410830192 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:19.136459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b7fcd-e145-4e4f-ae00-50fed605efbd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:19.171757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:19.172398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:19.172678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:19.172949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:19.178886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:19.179765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:19.180282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:19.180847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:19.181727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:19.182246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:19.183865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:19.184580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:19.186012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:19.196080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 448/892] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:19.202089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:19.203089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:19.204396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:19.204396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:19.204396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:19.204396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:19.204396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 445/893] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:19.209766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:19.266914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:19.331812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f60467-f213-4a56-90e0-2b27411e0270 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:19.371690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:19.372778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:19.373265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:19.373744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:19.374731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:19.375242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:19.376832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:19.392492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 449/894] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:19.396398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:19.401568 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:19.497964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646bbd1-e450-4869-aa6e-f2fbff4b0f5a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:19.532551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:19.533192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:19.533496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:19.533769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:19.541505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:19.542976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:19.555199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:19.556177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:19.557141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 446/895] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:03:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:19.562121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:19.672192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5683ae-256c-46cb-b27f-99f9711c3323 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:19.679809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:19.711731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:19.712355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:19.712635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:19.712954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:19.713754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:19.714063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:19.715541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:19.733421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 450/896] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 28 22:03:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:19.739648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:19.806257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:19.847219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126fb16-3d2a-477b-b0b7-513a9852a5a2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:19.882510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:19.883129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:19.883408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:19.883681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:19.952840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:19.954204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.016140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:20.057839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 447/897] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:19 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:20.063297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:20.168118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6b33-0133-4e45-b34b-f219c9e2c4bf None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:20.203810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:20.204376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.204656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.204929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.216115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:20.217557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:20.233254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:20.234214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:20.235500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:20.235500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:20.235500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:20.235500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:20.235500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 451/898] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:20.240433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:20.351748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466184-0697-4210-8561-22b8122bdab7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:20.388712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e335f6-3270-4e33-8154-f7221aedd318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:20.389709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e335f6-3270-4e33-8154-f7221aedd318 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.389990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e335f6-3270-4e33-8154-f7221aedd318 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.390289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e335f6-3270-4e33-8154-f7221aedd318 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.390983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e335f6-3270-4e33-8154-f7221aedd318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:20.391284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e335f6-3270-4e33-8154-f7221aedd318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:20.392700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e335f6-3270-4e33-8154-f7221aedd318 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.405402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 448/899] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:20.411399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:20.433059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:20.503496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d9b2-72dd-4827-b3d8-497f062d7177 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.503698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d9b2-72dd-4827-b3d8-497f062d7177 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.503962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d9b2-72dd-4827-b3d8-497f062d7177 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.505547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 449/900] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:20.510968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c077bb-6f15-43e9-94ba-6df3780c0ac7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.511254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c077bb-6f15-43e9-94ba-6df3780c0ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.511532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c077bb-6f15-43e9-94ba-6df3780c0ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.525016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0421f-6eea-4082-9825-51c3f33a9de7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:20.531365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d1c077bb-6f15-43e9-94ba-6df3780c0ac7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:20.532861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d1c077bb-6f15-43e9-94ba-6df3780c0ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:20.552278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:20.565736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:20.566451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.566686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.566960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.577645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:20.579260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:20.592213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:20.593134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:20.594033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 452/901] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:20.599274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:20.622371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 450/902] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:20.643481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c077bb-6f15-43e9-94ba-6df3780c0ac7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:20.688586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:20.714911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321c3b9-f23c-4c73-b8ae-92f3a5ab8adf None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:20.751249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:20.751929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.753010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.753309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.754119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:20.754419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:20.755862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.756077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c077bb-6f15-43e9-94ba-6df3780c0ac7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:20.769916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 453/903] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:20.776078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:20.795972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:20.797230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.797799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.798287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.799162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:20.800820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:20.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:20.811722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 22:03:20.812567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:20.821430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 451/904] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:20.822629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:20.843728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:20.887581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b6cd-4d91-4c69-a944-670b90ca202d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:20.925321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:20.926044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.926355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.926631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.927548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] RBAC: Adding query filter params (role.id=832a97a7ce404a3a93d7c88f6a6c5716, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=61cbae3b43bc49e1a221be07f06a57f6) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:20.927825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:20.929257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.932541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:20.938269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275aa6d-3823-4800-82dc-b2c45fc35a46 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:20.941241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 454/905] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/role_assignments?user.id=61cbae3b43bc49e1a221be07f06a57f6&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=832a97a7ce404a3a93d7c88f6a6c5716 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:20.980475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d0386-b11b-4588-a8c3-0517e8e9ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:20.981502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0386-b11b-4588-a8c3-0517e8e9ea64 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:20.981982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0386-b11b-4588-a8c3-0517e8e9ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:20.982498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0386-b11b-4588-a8c3-0517e8e9ea64 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:20.983427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d0386-b11b-4588-a8c3-0517e8e9ea64 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:20.983932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d0386-b11b-4588-a8c3-0517e8e9ea64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:20.985548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d0386-b11b-4588-a8c3-0517e8e9ea64 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:20.992254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 452/906] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:20.999401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:21.017173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe90e2-7a3c-44fc-ad17-4d50c3a6001d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.017367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe90e2-7a3c-44fc-ad17-4d50c3a6001d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.017638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe90e2-7a3c-44fc-ad17-4d50c3a6001d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.019241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 453/907] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:21.024447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5d7ef-0f4e-4e48-99d9-4f297a540c8a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.025036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5d7ef-0f4e-4e48-99d9-4f297a540c8a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.025507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5d7ef-0f4e-4e48-99d9-4f297a540c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.045667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0cb5d7ef-0f4e-4e48-99d9-4f297a540c8a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:21.047364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0cb5d7ef-0f4e-4e48-99d9-4f297a540c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:21.119955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a696f-226f-489f-a6aa-a98dfe9760d6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:21.122928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 454/908] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:21.145606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5d7ef-0f4e-4e48-99d9-4f297a540c8a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:21.156198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:21.156830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.157114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.157389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.158078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:21.158496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:21.159938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:21.169616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 455/909] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 28 22:03:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:21.169771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:21.170682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:21.237751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:21.261244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5d7ef-0f4e-4e48-99d9-4f297a540c8a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:21.279874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0b9f-4411-4c56-b174-d6a86c7f4f16 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:21.300400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:21.301115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.301407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.301707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.302376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:21.303747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:21.313370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:21.314378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:21.315831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:21.320117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 455/910] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jul 28 22:03:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:21.321127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:21.326682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476c92f-3358-4198-8253-0c6866a69178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:21.327718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c92f-3358-4198-8253-0c6866a69178 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.328001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c92f-3358-4198-8253-0c6866a69178 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.328276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c92f-3358-4198-8253-0c6866a69178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.329040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476c92f-3358-4198-8253-0c6866a69178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:21.330502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476c92f-3358-4198-8253-0c6866a69178 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:21.358676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 456/911] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:21.360423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055e20c-1d0d-451b-9124-65e34c5076d6 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.360711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055e20c-1d0d-451b-9124-65e34c5076d6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.361142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055e20c-1d0d-451b-9124-65e34c5076d6 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.367952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 457/912] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:21.369406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8cb3-842a-44c8-ae6d-a1bf226f7a32 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.369693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8cb3-842a-44c8-ae6d-a1bf226f7a32 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.369968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8cb3-842a-44c8-ae6d-a1bf226f7a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.391067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-16ca8cb3-842a-44c8-ae6d-a1bf226f7a32 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:21.392409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-16ca8cb3-842a-44c8-ae6d-a1bf226f7a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:21.427252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:21.460463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b232b8-3b98-4405-9897-5a4819992263 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:21.482726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 458/913] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:21.503241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:21.504191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8cb3-842a-44c8-ae6d-a1bf226f7a32 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:21.504470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.504973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.505444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.506533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:21.506852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:21.509350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:21.514850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 456/914] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:21.520764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:21.559323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:21.621872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8cb3-842a-44c8-ae6d-a1bf226f7a32 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:21.658160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6281c-2743-43bc-ae54-fa31a9e0399c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:21.660767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:21.661635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.662116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.662653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.663547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:21.665149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:21.686178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 459/915] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:21 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:03:21.710947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:21.711592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.711876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.712150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.712856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:21.713220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:21.714787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:21.717505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:21.721519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 457/916] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:21.731027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:21.851575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03bb9-7e33-489d-a456-9b804c2e8e1b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:21.859972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:21.891822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab218-a871-4476-92f7-fdfe3a8cef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:21.892452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab218-a871-4476-92f7-fdfe3a8cef4f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:21.892765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab218-a871-4476-92f7-fdfe3a8cef4f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:21.893049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab218-a871-4476-92f7-fdfe3a8cef4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:21.893917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ab218-a871-4476-92f7-fdfe3a8cef4f None admin] RBAC: Adding query filter params (interface=public, service_id=9f9d4c39f8e342358953c189f80a6a0f, region_id=RegionOne) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:21.894265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ab218-a871-4476-92f7-fdfe3a8cef4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:21.895707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ab218-a871-4476-92f7-fdfe3a8cef4f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:21.901861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 460/917] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:03:21 2022] GET /identity/v3/endpoints?service_id=9f9d4c39f8e342358953c189f80a6a0f&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:21.907386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:22.023632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ed3b-53ab-429b-9c8f-1a1adc2838a6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:22.058393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e05c4f-b500-49cd-8429-3d72f49e6da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:22.059016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e05c4f-b500-49cd-8429-3d72f49e6da5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:22.059299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e05c4f-b500-49cd-8429-3d72f49e6da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:22.059612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e05c4f-b500-49cd-8429-3d72f49e6da5 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:22.060274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e05c4f-b500-49cd-8429-3d72f49e6da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:22.061648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e05c4f-b500-49cd-8429-3d72f49e6da5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:22.068840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 458/918] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:21 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:03:23.009675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060148-414d-4e7c-b5b7-b4d6e2d7bac7 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.010397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060148-414d-4e7c-b5b7-b4d6e2d7bac7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.010397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060148-414d-4e7c-b5b7-b4d6e2d7bac7 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.011846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 461/919] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:23.017203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83090a-721a-440c-8abe-73c83c18067f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.017736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83090a-721a-440c-8abe-73c83c18067f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.018412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83090a-721a-440c-8abe-73c83c18067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.036645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1a83090a-721a-440c-8abe-73c83c18067f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:23.037828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1a83090a-721a-440c-8abe-73c83c18067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:23.101607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:23.112124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 459/920] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:23.139779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f060148-414d-4e7c-b5b7-b4d6e2d7bac7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:23.256539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f060148-414d-4e7c-b5b7-b4d6e2d7bac7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:23.293733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:23.294336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.294617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.294889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.307590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:23.312835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:23.313755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:23.315626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 462/921] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 28 22:03:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:23.322754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83090a-721a-440c-8abe-73c83c18067f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:23.432831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83090a-721a-440c-8abe-73c83c18067f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:23.468728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8ca95-262b-4847-9f7f-f456474b31a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:23.469402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8ca95-262b-4847-9f7f-f456474b31a7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.469687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8ca95-262b-4847-9f7f-f456474b31a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.469961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8ca95-262b-4847-9f7f-f456474b31a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.470727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8ca95-262b-4847-9f7f-f456474b31a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:23.471063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8ca95-262b-4847-9f7f-f456474b31a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:23.472432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8ca95-262b-4847-9f7f-f456474b31a7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:23.481505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 460/922] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 28 22:03:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:23.487758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:23.531542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:23.533505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5b5ec-68eb-4aa0-99df-58025f3accd3 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.533801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5b5ec-68eb-4aa0-99df-58025f3accd3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.534079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5b5ec-68eb-4aa0-99df-58025f3accd3 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.535741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 461/923] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:23.541045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295fbac-36e6-4de5-b4eb-2eda17e82f25 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.541335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295fbac-36e6-4de5-b4eb-2eda17e82f25 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.541611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295fbac-36e6-4de5-b4eb-2eda17e82f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.561287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f295fbac-36e6-4de5-b4eb-2eda17e82f25 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:23.562442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f295fbac-36e6-4de5-b4eb-2eda17e82f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:23.599379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59564c-2f9d-4fd1-ba76-9dc37b14078f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:23.619424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:23.645571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:23.646320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 462/924] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:23.646942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.647424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.647900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.659918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:23.661660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:23.665154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295fbac-36e6-4de5-b4eb-2eda17e82f25 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:23.680726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:23.681677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:23.682602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:23.682602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:23.682602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:23.682602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:23.688191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 463/925] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:23.690662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:23.782910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295fbac-36e6-4de5-b4eb-2eda17e82f25 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:23.796626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:23.818524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420b9b-9fa5-48cc-a04a-622b3260a07b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:23.822648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:23.823537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.824015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.824494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.825867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:23.827970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:23.831784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING keystone.server.flask.common [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 22:03:23.853540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8e384-35af-4ad9-8e21-8ecfff5e0d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:23.854148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8e384-35af-4ad9-8e21-8ecfff5e0d29 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.854297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.sql.core [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 22:03:23.854297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 22:03:23.854297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [parameters: {'id': '8878e3fc481f426fbb52fbe1e76bdb63', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 22:03:23.854297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 22:03:23.854552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8e384-35af-4ad9-8e21-8ecfff5e0d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.854749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8e384-35af-4ad9-8e21-8ecfff5e0d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.855393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8e384-35af-4ad9-8e21-8ecfff5e0d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:23.855697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8e384-35af-4ad9-8e21-8ecfff5e0d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:23.857051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8e384-35af-4ad9-8e21-8ecfff5e0d29 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8878e3fc481f426fbb52fbe1e76bdb63.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8878e3fc481f426fbb52fbe1e76bdb63. Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 22:03:23.871284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 22:03:23.872119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application yield resource Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise self.value Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application session.commit() Jul 28 22:03:23.873080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.flush() Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application compat.raise_( Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 22:03:23.873987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 22:03:23.874932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 22:03:23.875748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [parameters: {'id': '8878e3fc481f426fbb52fbe1e76bdb63', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:23.876616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:23.877521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8878e3fc481f426fbb52fbe1e76bdb63. Jul 28 22:03:23.884531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:23.886861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 464/926] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:23.886861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6db8-f0bb-49db-9096-4e8c6f5bafae None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:23.886861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6db8-f0bb-49db-9096-4e8c6f5bafae None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:23.886861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be6db8-f0bb-49db-9096-4e8c6f5bafae None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:23.887363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 463/927] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jul 28 22:03:23 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:23.887497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 465/928] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:23.887620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:23.887865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be6db8-f0bb-49db-9096-4e8c6f5bafae None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:23.928349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:23.995999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be6db8-f0bb-49db-9096-4e8c6f5bafae None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.001817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6d1a5-a1f1-45c5-81e4-5a49712fbe90 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.031079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dbc26-acc1-4b8d-9fe1-82d8f233dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.031710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbc26-acc1-4b8d-9fe1-82d8f233dced None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.031981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbc26-acc1-4b8d-9fe1-82d8f233dced None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.032247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbc26-acc1-4b8d-9fe1-82d8f233dced None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.037623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.038290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.038574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.038865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.039764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbc26-acc1-4b8d-9fe1-82d8f233dced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.041204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbc26-acc1-4b8d-9fe1-82d8f233dced None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.046832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.048489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-9d6dbc26-acc1-4b8d-9fe1-82d8f233dced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:24.052588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:24.053489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 466/929] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:24.055060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304907cc-9414-4e06-b9c0-ea84e413e531 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.055657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304907cc-9414-4e06-b9c0-ea84e413e531 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.055657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304907cc-9414-4e06-b9c0-ea84e413e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.061798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:24.065180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:24.066273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 464/930] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:03:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:24.072394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.075138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-304907cc-9414-4e06-b9c0-ea84e413e531 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:24.076024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-304907cc-9414-4e06-b9c0-ea84e413e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:24.150181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 467/931] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:24.151112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304907cc-9414-4e06-b9c0-ea84e413e531 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.192791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d61e-a28c-4142-b9eb-eea545df0ea9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.194643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.228631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.229252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.229529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.229797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.230540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:24.230844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.232263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.251814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 465/932] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:24.253248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.269182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304907cc-9414-4e06-b9c0-ea84e413e531 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.308287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.315157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6669-2275-464c-9138-fedbf0351dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.315956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6669-2275-464c-9138-fedbf0351dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.316257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6669-2275-464c-9138-fedbf0351dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.316618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6669-2275-464c-9138-fedbf0351dc2 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.317437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6669-2275-464c-9138-fedbf0351dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:24.317751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6669-2275-464c-9138-fedbf0351dc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.319374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6669-2275-464c-9138-fedbf0351dc2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.346967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 468/933] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:24.348291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747148a-be0d-498e-94a9-1a97d40c156b None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.348636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747148a-be0d-498e-94a9-1a97d40c156b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.348914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747148a-be0d-498e-94a9-1a97d40c156b None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.350386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 469/934] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:24.355228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747148a-be0d-498e-94a9-1a97d40c156b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.375555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff1f61-3ad1-4335-a5c7-861493233ab0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.419363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c93f-ed8b-4207-9a48-1f6d75c8d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.420849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c93f-ed8b-4207-9a48-1f6d75c8d56c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.420849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c93f-ed8b-4207-9a48-1f6d75c8d56c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.420849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c93f-ed8b-4207-9a48-1f6d75c8d56c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.421947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c93f-ed8b-4207-9a48-1f6d75c8d56c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.423627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c93f-ed8b-4207-9a48-1f6d75c8d56c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5450c93f-ed8b-4207-9a48-1f6d75c8d56c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:24.433460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:24.434697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:24.435632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:24.438340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 466/935] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:24.440256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe1ae-461d-49fe-808b-fb1d08c55151 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.440544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe1ae-461d-49fe-808b-fb1d08c55151 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.440868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe1ae-461d-49fe-808b-fb1d08c55151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.460868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cccfe1ae-461d-49fe-808b-fb1d08c55151 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:24.462438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cccfe1ae-461d-49fe-808b-fb1d08c55151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:24.481994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747148a-be0d-498e-94a9-1a97d40c156b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.484181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.527448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.528088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.528372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.528642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.537899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 467/936] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:24.539139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.539446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe1ae-461d-49fe-808b-fb1d08c55151 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.540742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:24.564413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:24.565978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:24.566957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:24.566957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:24.566957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:24.566957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:24.566957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 470/937] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:24.566957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.614817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.649970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe1ae-461d-49fe-808b-fb1d08c55151 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.679613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65b43-525a-49b0-b9a4-c11dfa463ffe None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.685340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.686142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.686608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.686881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.687552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:24.687854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.689215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.699136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 468/938] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:24.699136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.720401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.721328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.721992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.722317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.722597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.723307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.724754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:24.733731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:24.734740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:24.735604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 471/939] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:24.737038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.811630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c956-85b8-479d-94c6-d63fc791b9bb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.847281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caad24-bebb-4399-8f86-ab87ac7447fc None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:24.848730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.849413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.850369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.850369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.850653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:24.850956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.852335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.855229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.870256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 469/940] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:24.870256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.890399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:24.891235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:24.891670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:24.892118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:24.892823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:24.893128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:24.894535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:24.904849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 472/941] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:24.904849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:24.959463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:24.980259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665f32-df42-48e4-9a9b-4af3d184a9df None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.010794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a5bdd-72fa-43a5-aec6-8a50fba6e00e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.015704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.016324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.016600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.016865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.017522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:25.017847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.019233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.024685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 470/942] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:25.027217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:25.046449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.047094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.047371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.047644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.055120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.056562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:25.068675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:25.069576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:25.070499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 473/943] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:25.071008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:25.107236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:25.143363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92152572-0b3a-430c-8835-a21fd4e828b3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.177541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa18113-56ea-48eb-8caa-a8a7a78dc70c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.181221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.181843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.182127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.182433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.183184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] RBAC: Adding query filter params (interface=public, service_id=fb958e14e61743ce8f4a0dd387340a2e, region_id=RegionOne) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:25.183495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.184853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.195154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 471/944] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:03:25 2022] GET /identity/v3/endpoints?service_id=fb958e14e61743ce8f4a0dd387340a2e&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:25.195154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:25.202359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:25.220446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.221620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.221904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.222170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.222881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:25.223181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.224548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.229387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 474/945] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:25.230149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:25.311539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a8bd2-90c8-4837-8223-ef98abfe60b1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.332249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:25.341256 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3b807-ec2c-4316-a84a-8e0eb1f8966e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.347956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.348569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.348845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.349119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.349855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:25.350158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.351599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.363958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 472/946] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:25.364734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:25.386132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.386829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.387187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.387512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.388158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.389650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.397214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 475/947] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:25 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:03:25.397762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:25.475704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:25.515420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3fcd0-db03-4c2c-8140-ae12e8141d1c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.532304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01933661-7641-4cbc-9c8b-2d0edd936904 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:25.560584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ac6a5-2db3-4b62-855a-a5b0a6622f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.562114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac6a5-2db3-4b62-855a-a5b0a6622f13 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.562583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac6a5-2db3-4b62-855a-a5b0a6622f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.563020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ac6a5-2db3-4b62-855a-a5b0a6622f13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.564002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ac6a5-2db3-4b62-855a-a5b0a6622f13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.566665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ac6a5-2db3-4b62-855a-a5b0a6622f13 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.572841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7732c-333c-4027-b9c1-75d34a189d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:25.573829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7732c-333c-4027-b9c1-75d34a189d0e None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:25.574347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7732c-333c-4027-b9c1-75d34a189d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:25.574632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7732c-333c-4027-b9c1-75d34a189d0e None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/61cbae3b43bc49e1a221be07f06a57f6/roles/832a97a7ce404a3a93d7c88f6a6c5716` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:25.576935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7732c-333c-4027-b9c1-75d34a189d0e None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=61cbae3b43bc49e1a221be07f06a57f6, role_id=832a97a7ce404a3a93d7c88f6a6c5716)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:25.578528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7732c-333c-4027-b9c1-75d34a189d0e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:25.592686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 473/948] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:25.593643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 476/949] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:03:25 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/61cbae3b43bc49e1a221be07f06a57f6/roles/832a97a7ce404a3a93d7c88f6a6c5716 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:03:26.321582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f74f72-4079-4370-b60f-c5d217b05552 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:26.322130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f74f72-4079-4370-b60f-c5d217b05552 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:26.322130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f74f72-4079-4370-b60f-c5d217b05552 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:26.323759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 474/950] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:26.329105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dda3d7-db3d-4b2b-aa6f-a8ed13d72fb5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:26.329539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dda3d7-db3d-4b2b-aa6f-a8ed13d72fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:26.329717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dda3d7-db3d-4b2b-aa6f-a8ed13d72fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:26.349503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f8dda3d7-db3d-4b2b-aa6f-a8ed13d72fb5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:26.350736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f8dda3d7-db3d-4b2b-aa6f-a8ed13d72fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:26.364282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:26.427644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 477/951] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:26.450788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f74f72-4079-4370-b60f-c5d217b05552 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:26.560649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f74f72-4079-4370-b60f-c5d217b05552 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:26.586460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:26.599405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:26.600352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:26.600857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:26.601334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:26.602256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:26.603980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:26.619844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.sql.core [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 22:03:26.619844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 22:03:26.619844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [parameters: {'user_id': '39a2531a0aad4894b5aff4c5926f65fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 22:03:26.619844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 28 22:03:26.629046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 22:03:26.629936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application yield resource Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application next(self.gen) Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise self.value Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application session.commit() Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 22:03:26.630935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.session.flush() Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application compat.raise_( Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 22:03:26.631972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 22:03:26.632896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application conn.query(q) Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application result.read() Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 22:03:26.635607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [parameters: {'user_id': '39a2531a0aad4894b5aff4c5926f65fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:26.637626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 22:03:26.639571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 22:03:26.641870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 22:03:26.641870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 22:03:26.641870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 22:03:26.641870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 22:03:26.641870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 22:03:26.641870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:26.644718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 475/952] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 28 22:03:26 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:26.650471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dda3d7-db3d-4b2b-aa6f-a8ed13d72fb5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:26.759304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dda3d7-db3d-4b2b-aa6f-a8ed13d72fb5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:26.796493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888760f1-4128-4698-bf36-762e50ba37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:26.797501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888760f1-4128-4698-bf36-762e50ba37e5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:26.798003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888760f1-4128-4698-bf36-762e50ba37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:26.798605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888760f1-4128-4698-bf36-762e50ba37e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:26.806550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888760f1-4128-4698-bf36-762e50ba37e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:26.808215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888760f1-4128-4698-bf36-762e50ba37e5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-888760f1-4128-4698-bf36-762e50ba37e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:26.820808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:26.821751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 22:03:26.822824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:26.825445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 478/953] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:26.831758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:26.936242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3311-b9de-4e7d-92c2-7298217e1935 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:26.970586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba72998-f482-4bbc-b06f-61f95f54ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:26.971955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72998-f482-4bbc-b06f-61f95f54ec25 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:26.972646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72998-f482-4bbc-b06f-61f95f54ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:26.973257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72998-f482-4bbc-b06f-61f95f54ec25 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:26.974270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba72998-f482-4bbc-b06f-61f95f54ec25 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:26.974771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba72998-f482-4bbc-b06f-61f95f54ec25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:26.976590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba72998-f482-4bbc-b06f-61f95f54ec25 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:27.015615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 476/954] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 28 22:03:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:27.541011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17937-9556-4d3c-b5c0-f02bb1f648f1 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.541562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17937-9556-4d3c-b5c0-f02bb1f648f1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.541562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17937-9556-4d3c-b5c0-f02bb1f648f1 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.543088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 479/955] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:27.548242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c6fbc-95d9-43d4-81aa-b4399226a89e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.548627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c6fbc-95d9-43d4-81aa-b4399226a89e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.549412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c6fbc-95d9-43d4-81aa-b4399226a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.567746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c95c6fbc-95d9-43d4-81aa-b4399226a89e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:27.569245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c95c6fbc-95d9-43d4-81aa-b4399226a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:27.611993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:27.635610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd1fb-944d-4972-a1a4-a302260c5a43 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.635933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd1fb-944d-4972-a1a4-a302260c5a43 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.636150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd1fb-944d-4972-a1a4-a302260c5a43 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.638386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 480/956] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:27.642468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36d80-d160-4383-b616-5eb4f62a3899 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.642831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36d80-d160-4383-b616-5eb4f62a3899 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.643173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36d80-d160-4383-b616-5eb4f62a3899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.650446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 477/957] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:27.652376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:27.653934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a3eee-7b7b-48b2-a1c4-25b8b252128f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.654364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a3eee-7b7b-48b2-a1c4-25b8b252128f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.654586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a3eee-7b7b-48b2-a1c4-25b8b252128f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.655912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 478/958] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:27.661162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b173e-6b34-4921-93ea-f1f734c45a96 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.661439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b173e-6b34-4921-93ea-f1f734c45a96 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.661707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b173e-6b34-4921-93ea-f1f734c45a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.664645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e3a36d80-d160-4383-b616-5eb4f62a3899 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:27.665844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e3a36d80-d160-4383-b616-5eb4f62a3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:27.680108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c36b173e-6b34-4921-93ea-f1f734c45a96 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:27.681280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c36b173e-6b34-4921-93ea-f1f734c45a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:27.734197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 481/959] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:27.735225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36d80-d160-4383-b616-5eb4f62a3899 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:27.746860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 479/960] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:27.759208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b173e-6b34-4921-93ea-f1f734c45a96 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:27.832992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36d80-d160-4383-b616-5eb4f62a3899 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:27.856587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b173e-6b34-4921-93ea-f1f734c45a96 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:27.858937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:27.866831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:27.867473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.867752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.868024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.868648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:27.870014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:27.871811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:27.880081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:27.881307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:27.882157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 482/961] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:27.883008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:27.893389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:27.894035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:27.894343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:27.894616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:27.904563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:27.910030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:27.911112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:27.911948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:27.914375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 480/962] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 28 22:03:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:27.915332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:27.980429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a750-e487-438d-b2e8-9219d98aa2ea None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.012002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6eb7b-1e56-4906-8690-731aa7293dc0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.015348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.015986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.016267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.016538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.017152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.019074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:28.028104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:28.029105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:28.029957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 483/963] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:28.031031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.051511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.052117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.052392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.052661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.053328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:28.053625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.055230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.061105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 481/964] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:28.061876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.092816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:28.101274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:28.146563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651d4c3-4783-4f12-a782-5d3ef861e8cf None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.165540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf29b-116d-4b92-991e-2667e2a7e2d6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.179500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.180116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.180401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.180673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.181386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:28.181691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.183085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.192393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 484/965] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:28.193162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.199079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.199692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.199967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.200231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.200888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:28.201204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.202575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.212734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 482/966] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:28.212734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.291377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871314e4-329a-4ca5-b245-456a070dbec4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.300282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:28.308952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb2f2e-8c7a-4c71-b750-073bac562119 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.313657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:28.325002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.325610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.325886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.326153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.326843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:28.327142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.328504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.333812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 485/967] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:28.334598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.343865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.344440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.344729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.345005 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.354892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.356328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:28.370918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:28.371996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:28.373003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:28.373003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:28.373003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:28.373003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:28.373003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 483/968] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:28.373364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.433942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3390dbc-e833-420a-8992-d35aaa316dbd None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.467246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.467848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.468123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.468389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.469048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:28.469346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.470753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.471424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ce712-e645-4811-b0d0-84865c2ff7a1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.475710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 486/969] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:28.476474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.509592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.510240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.510547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.510822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.511552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.512987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.532929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:28.550267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 484/970] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:28.565590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:28.622850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf82cc-97ad-41dd-adca-7130696abe46 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.672291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.672921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.673201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.673465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.674696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:28.674997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.676388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.691071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 487/971] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:28.696010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.801857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550dfaf-c5a6-437b-ba37-b5c406f681d2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.835857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:28.836554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:28.836829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:28.837096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:28.845497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:28.847547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:28.858923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:28.859865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:28.866336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 485/972] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:28.868595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:28.969088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901faa9-a881-4ea6-9f13-41704850308e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:28.979124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:29.006441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:29.007069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:29.007349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:29.007648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:29.008447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:29.008751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:29.010178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:29.028209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 488/973] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 28 22:03:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:29.034462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:29.094680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:29.148038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba20b7-30cb-4b23-b3ec-182297a1004c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:29.183073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:29.183693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:29.183972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:29.184243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:29.252373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:29.254002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:29.310985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:29.360814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 486/974] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:29.362094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:29.468805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018571-f1cd-4ea1-a44a-26d9653ddb27 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:29.503415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:29.504062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:29.504410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:29.504749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:29.514768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:29.516270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:29.531268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:29.532357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:29.534040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:29.534040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:29.534040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:29.534040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:29.539097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 489/975] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:29.540020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:29.650803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421cd14-40cd-43b1-b85b-c64d23a7c795 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:29.687165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:29.687790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:29.688075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:29.688342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:29.689096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:29.689865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:29.691316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:29.706270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 487/976] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:29.709832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:29.729876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:29.812322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf1e6-f1ea-4a89-8704-87b855f6e9b9 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:29.846202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:29.846869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:29.847149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:29.847425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:29.854178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:29.855637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:29.867036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:29.867921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:29.868852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 490/977] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:29.875207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:29.898545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:29.978272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65396c-8cda-4492-bf52-5a8a41ef84a3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:30.013708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebc62f-eebe-48f5-a2b0-0d9002addc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:30.014526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebc62f-eebe-48f5-a2b0-0d9002addc20 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.014909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebc62f-eebe-48f5-a2b0-0d9002addc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.015284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebc62f-eebe-48f5-a2b0-0d9002addc20 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.016131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebc62f-eebe-48f5-a2b0-0d9002addc20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:30.016541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebc62f-eebe-48f5-a2b0-0d9002addc20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:30.018131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebc62f-eebe-48f5-a2b0-0d9002addc20 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:30.035573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 488/978] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:30.036798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:30.122092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:30.148037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdfe66-f81d-4e8f-89ca-d16bdd0aca76 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:30.183228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36593-df34-4335-999b-fca0caf2eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:30.183945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36593-df34-4335-999b-fca0caf2eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.184289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36593-df34-4335-999b-fca0caf2eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.184634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36593-df34-4335-999b-fca0caf2eaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.185551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36593-df34-4335-999b-fca0caf2eaa6 None admin] RBAC: Adding query filter params (role.id=832a97a7ce404a3a93d7c88f6a6c5716, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=61cbae3b43bc49e1a221be07f06a57f6) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:30.185916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36593-df34-4335-999b-fca0caf2eaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:30.187389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36593-df34-4335-999b-fca0caf2eaa6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:30.194418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 491/979] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:30 2022] GET /identity/v3/role_assignments?user.id=61cbae3b43bc49e1a221be07f06a57f6&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=832a97a7ce404a3a93d7c88f6a6c5716 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:30.499398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb083b37-ba0d-4690-ba3c-d2bcec5c6997 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.499585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb083b37-ba0d-4690-ba3c-d2bcec5c6997 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.499878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb083b37-ba0d-4690-ba3c-d2bcec5c6997 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.501243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 489/980] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:30.506685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d6a43-a66d-4f94-992f-d598eff828d1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.506976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d6a43-a66d-4f94-992f-d598eff828d1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.507250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d6a43-a66d-4f94-992f-d598eff828d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.525597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-118d6a43-a66d-4f94-992f-d598eff828d1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:30.526806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-118d6a43-a66d-4f94-992f-d598eff828d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:30.552520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515b40-c86f-4071-b244-7c124f420d18 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.552803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515b40-c86f-4071-b244-7c124f420d18 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.553077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515b40-c86f-4071-b244-7c124f420d18 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.554454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 490/981] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:30.559230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6c1e-eb01-4d1d-8376-4accc654a1f6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.559518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6c1e-eb01-4d1d-8376-4accc654a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.559789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6c1e-eb01-4d1d-8376-4accc654a1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.577556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-394d6c1e-eb01-4d1d-8376-4accc654a1f6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:30.578806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-394d6c1e-eb01-4d1d-8376-4accc654a1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:30.602282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 492/982] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:30.622497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d6a43-a66d-4f94-992f-d598eff828d1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:30.648881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 491/983] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:30.671023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6c1e-eb01-4d1d-8376-4accc654a1f6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:30.685866 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:30.694218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:30.728178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d6a43-a66d-4f94-992f-d598eff828d1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:30.766720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:30.767463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.767798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.768177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.768853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:30.770277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:30.777208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6c1e-eb01-4d1d-8376-4accc654a1f6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:30.790278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 493/984] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:30 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:03:30.827101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:30.828137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:30.828634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:30.829114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:30.829996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:30.831649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:30.841814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:30.842952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:30.843792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:30.844530 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 492/985] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:30.851112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:30.962330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5574-93dd-44ac-904c-586dbcaf940c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:30.992302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:30.998121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:30.999128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:31.000038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:31.000252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:31.001104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:31.001772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:31.004383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:31.010066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 494/986] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:31.015755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:31.087885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:31.121019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a3e69-9236-44a9-9b69-87fbdcd75ee8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:31.159635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:31.160479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:31.160899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:31.161324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:31.162131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:31.162614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:31.164229 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:31.169433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 493/987] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:31.176167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:31.276939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d49b-7c92-4ec5-ab20-bb0ecbb91fe6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:31.311498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d0a1a-6c37-4f40-a0e8-1974f5351433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:31.312117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0a1a-6c37-4f40-a0e8-1974f5351433 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:31.312391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0a1a-6c37-4f40-a0e8-1974f5351433 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:31.312659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0a1a-6c37-4f40-a0e8-1974f5351433 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:31.313408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d0a1a-6c37-4f40-a0e8-1974f5351433 None admin] RBAC: Adding query filter params (interface=admin, service_id=fb958e14e61743ce8f4a0dd387340a2e, region_id=RegionOne) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:31.313715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d0a1a-6c37-4f40-a0e8-1974f5351433 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:31.315655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d0a1a-6c37-4f40-a0e8-1974f5351433 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:31.325514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 495/988] 10.222.0.48 () {56 vars in 1249 bytes} [Thu Jul 28 22:03:31 2022] GET /identity/v3/endpoints?service_id=fb958e14e61743ce8f4a0dd387340a2e&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:31.327374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:31.434624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09688ae-63e2-4167-94d2-014b8278f10b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:31.467729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dba357-bbe0-4e07-8c8e-bbc891eea766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:31.468626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba357-bbe0-4e07-8c8e-bbc891eea766 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:31.469080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba357-bbe0-4e07-8c8e-bbc891eea766 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:31.469523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba357-bbe0-4e07-8c8e-bbc891eea766 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:31.470391 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dba357-bbe0-4e07-8c8e-bbc891eea766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:31.472615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dba357-bbe0-4e07-8c8e-bbc891eea766 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:31.473831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:31.486276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 494/989] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:31 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:03:32.219862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48727f-0bca-45c1-b1ae-2e5c000471c8 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:32.220370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48727f-0bca-45c1-b1ae-2e5c000471c8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:32.220517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48727f-0bca-45c1-b1ae-2e5c000471c8 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:32.222467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 496/990] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:32.227421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad221f3a-c5f7-4a40-b82d-2c449f17855c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:32.227815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad221f3a-c5f7-4a40-b82d-2c449f17855c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:32.227972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad221f3a-c5f7-4a40-b82d-2c449f17855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:32.245791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ad221f3a-c5f7-4a40-b82d-2c449f17855c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:32.247001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ad221f3a-c5f7-4a40-b82d-2c449f17855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:32.314559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 495/991] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:32.335897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48727f-0bca-45c1-b1ae-2e5c000471c8 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:32.399798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:32.442368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48727f-0bca-45c1-b1ae-2e5c000471c8 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:32.476226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:32.476873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:32.477151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:32.477421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] PATH_INFO: `/v3/services/image` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:32.478038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:32.479436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:32.488287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:32.489265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:32.490120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:32.496214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 497/992] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jul 28 22:03:32 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:32.496339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad221f3a-c5f7-4a40-b82d-2c449f17855c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:32.603024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad221f3a-c5f7-4a40-b82d-2c449f17855c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:32.629898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:32.638759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc97187-ebd6-4ed5-b3e8-f08cac9e673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:32.639400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc97187-ebd6-4ed5-b3e8-f08cac9e673a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:32.639676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc97187-ebd6-4ed5-b3e8-f08cac9e673a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:32.639942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc97187-ebd6-4ed5-b3e8-f08cac9e673a None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:32.640603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc97187-ebd6-4ed5-b3e8-f08cac9e673a None admin] RBAC: Adding query filter params (name=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:32.640901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc97187-ebd6-4ed5-b3e8-f08cac9e673a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:32.642269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc97187-ebd6-4ed5-b3e8-f08cac9e673a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:32.652918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 496/993] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:32.653870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:32.752360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5335-c46f-440d-9a04-a1941a62ac24 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:32.775839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:32.788396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78193c-1425-4b28-8676-634db0e15a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:32.789122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78193c-1425-4b28-8676-634db0e15a8b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:32.789419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78193c-1425-4b28-8676-634db0e15a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:32.789803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78193c-1425-4b28-8676-634db0e15a8b None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:32.790565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78193c-1425-4b28-8676-634db0e15a8b None admin] RBAC: Adding query filter params (type=image) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:32.790866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78193c-1425-4b28-8676-634db0e15a8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:32.792229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78193c-1425-4b28-8676-634db0e15a8b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:32.796898 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 498/994] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:32.843196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec440-cedb-4d1a-ae4b-6998c952946e None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:32.843522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec440-cedb-4d1a-ae4b-6998c952946e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:32.843755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec440-cedb-4d1a-ae4b-6998c952946e None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:32.845342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 497/995] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:32.851087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c0dc-0b1e-4519-8f95-c81725aee8b6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:32.851378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c0dc-0b1e-4519-8f95-c81725aee8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:32.851646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616c0dc-0b1e-4519-8f95-c81725aee8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:32.870579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-1616c0dc-0b1e-4519-8f95-c81725aee8b6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:32.871801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1616c0dc-0b1e-4519-8f95-c81725aee8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:32.947897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 499/996] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:32.969973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec440-cedb-4d1a-ae4b-6998c952946e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:33.075734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec440-cedb-4d1a-ae4b-6998c952946e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:33.116473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:33.117127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.117458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.117738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.118395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:33.119762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:33.129746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:33.130807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:33.131653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:33.136946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 498/997] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:33.137964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616c0dc-0b1e-4519-8f95-c81725aee8b6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:33.239550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616c0dc-0b1e-4519-8f95-c81725aee8b6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:33.258358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:33.276072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:33.276697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.276978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.277250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.277924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:33.278239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:33.279614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:33.284684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 500/998] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:33.290084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:33.347964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:33.395812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecde029-279c-46e7-ab66-ae599a2b2c79 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:33.430122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f5390-4356-400d-875a-827d02953ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:33.430780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f5390-4356-400d-875a-827d02953ccf None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.431068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f5390-4356-400d-875a-827d02953ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.431340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f5390-4356-400d-875a-827d02953ccf None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.432070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f5390-4356-400d-875a-827d02953ccf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:33.432436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f5390-4356-400d-875a-827d02953ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:33.433847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f5390-4356-400d-875a-827d02953ccf None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:33.439013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 499/999] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:33.444788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:33.495635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ce7d-1426-45c4-b4a4-ea64ca38fb4b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.495844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ce7d-1426-45c4-b4a4-ea64ca38fb4b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.496121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ce7d-1426-45c4-b4a4-ea64ca38fb4b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.497475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 500/1000] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:33.502425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d9fea-7a72-46b2-9138-340843796237 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.502962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d9fea-7a72-46b2-9138-340843796237 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.503232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d9fea-7a72-46b2-9138-340843796237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.520967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ea3d9fea-7a72-46b2-9138-340843796237 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:33.522155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ea3d9fea-7a72-46b2-9138-340843796237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:33.550452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ad10e-aed0-4cbd-a051-1638880df02a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:33.587206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:33.587816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.588138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.588432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.589174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] RBAC: Adding query filter params (interface=public, service_id=136951b7f5f0420eaad8d589767fef8b, region_id=RegionOne) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:33.589479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:33.590460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 501/1001] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:33.590860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:33.601012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 501/1002] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:03:33 2022] GET /identity/v3/endpoints?service_id=136951b7f5f0420eaad8d589767fef8b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:33.602115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d9fea-7a72-46b2-9138-340843796237 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:33.614994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:33.658979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:33.663698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:33.712322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d9fea-7a72-46b2-9138-340843796237 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:33.721868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c705-a0d2-4111-b9fc-15a48e32f8d6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:33.749677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:33.750216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.750518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.750872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.751422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:33.753071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:33.758187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:33.758868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.759146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.759610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.759717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 502/1003] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:33 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:03:33.760130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:33.761562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:33.771811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:33.772889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:33.773766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 502/1004] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 28 22:03:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:33.779670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:33.890721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f7213-0409-497d-a7fd-8039731cb017 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:33.908895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:33.931374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:33.931994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:33.932277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:33.932543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:33.933211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:33.933511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:33.934901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:33.939875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 503/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:33.945840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:34.046967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524e6d5-6783-42c8-b259-56b76e54c880 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:34.057096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:34.083278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f706e5-a2f1-45c6-91eb-f05ab2db20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:34.083931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f706e5-a2f1-45c6-91eb-f05ab2db20c2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:34.084215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f706e5-a2f1-45c6-91eb-f05ab2db20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:34.084546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f706e5-a2f1-45c6-91eb-f05ab2db20c2 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:34.085227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f706e5-a2f1-45c6-91eb-f05ab2db20c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:34.085582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f706e5-a2f1-45c6-91eb-f05ab2db20c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:34.087003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f706e5-a2f1-45c6-91eb-f05ab2db20c2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:34.092321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 503/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 28 22:03:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:34.097887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:34.201874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da65cf1-efab-4860-9cec-0d84fe9642e2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:34.237351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b3c3f-aa79-4073-984e-90f6d4afd878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:34.237974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b3c3f-aa79-4073-984e-90f6d4afd878 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:34.238272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b3c3f-aa79-4073-984e-90f6d4afd878 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:34.238551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b3c3f-aa79-4073-984e-90f6d4afd878 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:34.239266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b3c3f-aa79-4073-984e-90f6d4afd878 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:34.240625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b3c3f-aa79-4073-984e-90f6d4afd878 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:34.259143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 504/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:03:34.803500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c57b-5fef-4c5f-908a-80f2fc2d2000 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:34.804023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c57b-5fef-4c5f-908a-80f2fc2d2000 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:34.804323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c57b-5fef-4c5f-908a-80f2fc2d2000 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:34.805644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 504/1008] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:34.810631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec132-9628-45b4-a00c-b8b467258b4f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:34.811048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec132-9628-45b4-a00c-b8b467258b4f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:34.811213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec132-9628-45b4-a00c-b8b467258b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:34.829467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6a6ec132-9628-45b4-a00c-b8b467258b4f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:34.830693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6a6ec132-9628-45b4-a00c-b8b467258b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:34.861817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:34.914266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 505/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:34.933148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c57b-5fef-4c5f-908a-80f2fc2d2000 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:35.035598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c57b-5fef-4c5f-908a-80f2fc2d2000 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:35.068263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cf43c-6f2f-4baa-9542-6e27635438da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:35.068810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf43c-6f2f-4baa-9542-6e27635438da None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:35.069087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf43c-6f2f-4baa-9542-6e27635438da None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:35.069354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cf43c-6f2f-4baa-9542-6e27635438da None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:35.070041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cf43c-6f2f-4baa-9542-6e27635438da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:35.071420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cf43c-6f2f-4baa-9542-6e27635438da None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:35.086098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 505/1010] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:34 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:35.783030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5feb10-63de-4ffe-a979-7e6fede86f11 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:35.783385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5feb10-63de-4ffe-a979-7e6fede86f11 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:35.783576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5feb10-63de-4ffe-a979-7e6fede86f11 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:35.785105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 506/1011] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:35.790906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21106a22-7630-4886-b516-aadbda9f6c4e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:35.791204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21106a22-7630-4886-b516-aadbda9f6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:35.791482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21106a22-7630-4886-b516-aadbda9f6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:35.809343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-21106a22-7630-4886-b516-aadbda9f6c4e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:35.810552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-21106a22-7630-4886-b516-aadbda9f6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:35.839365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:35.889356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 506/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:35 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:35.912025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5feb10-63de-4ffe-a979-7e6fede86f11 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:36.019698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5feb10-63de-4ffe-a979-7e6fede86f11 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:36.053264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:36.053830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.054106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.054409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.055157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:36.059890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:36.069813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:36.070902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 22:03:36.073382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:36.074845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 507/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:36.086211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21106a22-7630-4886-b516-aadbda9f6c4e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:36.206254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21106a22-7630-4886-b516-aadbda9f6c4e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:36.243520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac3da0-ece0-4e3f-9e4c-1bbbe0447750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:36.244168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac3da0-ece0-4e3f-9e4c-1bbbe0447750 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.244452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac3da0-ece0-4e3f-9e4c-1bbbe0447750 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.244728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac3da0-ece0-4e3f-9e4c-1bbbe0447750 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.245419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac3da0-ece0-4e3f-9e4c-1bbbe0447750 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:36.245727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac3da0-ece0-4e3f-9e4c-1bbbe0447750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:36.247158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac3da0-ece0-4e3f-9e4c-1bbbe0447750 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:36.253597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 507/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:36.259088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:36.278511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c320752-98ed-4a53-92f8-30c09ad8496c None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.278800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c320752-98ed-4a53-92f8-30c09ad8496c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.279069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c320752-98ed-4a53-92f8-30c09ad8496c None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.280567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 508/1015] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:36.285670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9d23-0859-4883-8378-d295040aa163 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.285955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9d23-0859-4883-8378-d295040aa163 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.286243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9d23-0859-4883-8378-d295040aa163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.293799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:36.306804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f74b9d23-0859-4883-8378-d295040aa163 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:36.307927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f74b9d23-0859-4883-8378-d295040aa163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:36.327342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:36.381688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 509/1016] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:36.382214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a334e1-73d2-49f0-9b2c-9f185b282d6e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:36.404303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b9d23-0859-4883-8378-d295040aa163 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:36.415891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:36.416508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.416784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.417056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.417778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] RBAC: Adding query filter params (type=compute) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:36.418133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:36.419775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:36.427599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 508/1017] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 28 22:03:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:36.433227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:36.516478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b9d23-0859-4883-8378-d295040aa163 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:36.544768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:36.556746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9444ef8-b0b2-46a6-8cf3-37620e72c3ed None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:36.561759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:36.562431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.562715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.563031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.564284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:36.565835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:36.567736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 510/1018] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:36.573459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:36.610379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58094c5-fa86-4de7-a54d-c2016ab8d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:36.611983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58094c5-fa86-4de7-a54d-c2016ab8d832 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.612294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58094c5-fa86-4de7-a54d-c2016ab8d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.612713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58094c5-fa86-4de7-a54d-c2016ab8d832 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.613518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58094c5-fa86-4de7-a54d-c2016ab8d832 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:36.613960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:36.614900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58094c5-fa86-4de7-a54d-c2016ab8d832 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:36.638090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 509/1019] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:03:36.713960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24374c0-9a68-4afd-bb1c-303302ff0f82 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:36.759245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fe623-d4e6-4297-91fc-770ba4be92a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:36.760137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe623-d4e6-4297-91fc-770ba4be92a4 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:36.760596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe623-d4e6-4297-91fc-770ba4be92a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:36.761036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe623-d4e6-4297-91fc-770ba4be92a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:36.761870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fe623-d4e6-4297-91fc-770ba4be92a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:36.763609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fe623-d4e6-4297-91fc-770ba4be92a4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:36.795335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 511/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:03:36 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:03:37.159411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a903017-1537-488a-9da0-fc213ae12ddb None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:37.159973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a903017-1537-488a-9da0-fc213ae12ddb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:37.159973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a903017-1537-488a-9da0-fc213ae12ddb None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:37.161460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 510/1021] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:37.166462 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8b3e-bc4a-49b0-ba13-c87e2c371bf0 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:37.166847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8b3e-bc4a-49b0-ba13-c87e2c371bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:37.167042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e8b3e-bc4a-49b0-ba13-c87e2c371bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:37.185065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7c5e8b3e-bc4a-49b0-ba13-c87e2c371bf0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:37.186391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7c5e8b3e-bc4a-49b0-ba13-c87e2c371bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:37.250152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:37.259281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 512/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:37.281671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a903017-1537-488a-9da0-fc213ae12ddb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:37.387635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a903017-1537-488a-9da0-fc213ae12ddb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:37.427852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:37.428498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:37.428776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:37.429049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] PATH_INFO: `/v3/services/image` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:37.429674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:37.431071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:37.440618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:37.441811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:37.442688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 511/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jul 28 22:03:37 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:37.448360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e8b3e-bc4a-49b0-ba13-c87e2c371bf0 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:37.550296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e8b3e-bc4a-49b0-ba13-c87e2c371bf0 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:37.585384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:37.586010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:37.586332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:37.586604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:37.587277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] RBAC: Adding query filter params (name=image) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:37.587575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:37.589020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:37.598958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 513/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:37.600951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:37.617243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:37.706352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d5a75-0a72-4e67-b816-94a6e0c31702 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:37.739989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:37.740602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:37.740876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:37.741141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:37.741800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] RBAC: Adding query filter params (type=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:37.742099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:37.743502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:37.754074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 512/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:37.755429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:37.820665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:37.865026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda404-1e3c-47a7-be1d-41f9a8436535 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:37.899300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42c7ae-08f0-4172-83c9-1438e4287fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:37.899977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42c7ae-08f0-4172-83c9-1438e4287fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:37.900257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42c7ae-08f0-4172-83c9-1438e4287fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:37.900524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42c7ae-08f0-4172-83c9-1438e4287fe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:37.901270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42c7ae-08f0-4172-83c9-1438e4287fe7 None admin] RBAC: Adding query filter params (interface=public, service_id=b079a01634074a08863a343bd0c1d468, region_id=RegionOne) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:37.901575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42c7ae-08f0-4172-83c9-1438e4287fe7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:37.902949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42c7ae-08f0-4172-83c9-1438e4287fe7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:37.910766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 514/1026] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:03:37 2022] GET /identity/v3/endpoints?service_id=b079a01634074a08863a343bd0c1d468&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:37.913940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:37.996876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:38.021047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa80022-1f7c-44e4-a17d-c7b6def57d77 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:38.055681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2d7e-a412-4b59-b671-38a443d555b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:38.056293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2d7e-a412-4b59-b671-38a443d555b2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:38.056570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2d7e-a412-4b59-b671-38a443d555b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:38.056839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2d7e-a412-4b59-b671-38a443d555b2 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:38.057480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2d7e-a412-4b59-b671-38a443d555b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:38.058868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2d7e-a412-4b59-b671-38a443d555b2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:38.074265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 513/1027] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:03:37 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:03:38.843738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe317-c73b-41d6-b570-998b0517e25c None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:38.844265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe317-c73b-41d6-b570-998b0517e25c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:38.844265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe317-c73b-41d6-b570-998b0517e25c None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:38.845667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 515/1028] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:38.849374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba15d-4fb3-4a70-92a2-16361154ff68 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:38.850133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba15d-4fb3-4a70-92a2-16361154ff68 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:38.850611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba15d-4fb3-4a70-92a2-16361154ff68 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:38.850744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fed70-f3c2-4c62-8cea-9f34bb3774ef None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:38.851022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fed70-f3c2-4c62-8cea-9f34bb3774ef None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:38.851290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fed70-f3c2-4c62-8cea-9f34bb3774ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:38.852353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 514/1029] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:38.857299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd470c0-11d5-4d5f-8692-d0b225061fbf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:38.857698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd470c0-11d5-4d5f-8692-d0b225061fbf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:38.858010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd470c0-11d5-4d5f-8692-d0b225061fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:38.870463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d67fed70-f3c2-4c62-8cea-9f34bb3774ef None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:38.871678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d67fed70-f3c2-4c62-8cea-9f34bb3774ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:38.875548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cfd470c0-11d5-4d5f-8692-d0b225061fbf None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:38.877248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cfd470c0-11d5-4d5f-8692-d0b225061fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:38.943329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 516/1030] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:38.947715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 515/1031] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:38.966185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fed70-f3c2-4c62-8cea-9f34bb3774ef None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:38.972971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd470c0-11d5-4d5f-8692-d0b225061fbf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:39.025328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:39.048931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:39.070746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fed70-f3c2-4c62-8cea-9f34bb3774ef None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.082912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd470c0-11d5-4d5f-8692-d0b225061fbf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.110327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.111440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.111715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.111983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.122275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:39.123319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.124076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.124354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.124617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.125745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:39.127940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:39.128857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:39.138000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:39.138733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:39.139297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 517/1032] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 28 22:03:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:39.139387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 516/1033] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:39.139460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:39.139539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:39.248525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b854bfd-af1a-4899-8ebe-b42195c14009 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.253812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76978422-678f-47f6-aac7-62cf694a57cb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.271674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:39.286290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.286913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.287187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.287462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.288134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:39.289594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:39.290643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.291262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.291540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.291805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.292507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:39.292807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:39.294146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:39.300440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:39.303507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 518/1034] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 28 22:03:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:39.309242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:39.323142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 517/1035] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:03:39 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:39.423158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c74706-741f-47f2-b0b2-16a671c9b935 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.459735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.460442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.460724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.460998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.472739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:39.474193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:39.489300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:39.490218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:39.491156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:39.491156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:39.491156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:39.491156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:39.491156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 519/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:39.497532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:39.609515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d8fca-4c48-43cf-9000-3f434f144e66 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.643517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.644143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.644425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.644696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.645395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:39.645699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:39.647089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:39.659676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 518/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:39.665467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:39.698127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:39.770076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e71e-97e9-4394-ae32-0226b91b35b5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.804771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.805415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.805696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.805971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.814183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:39.815660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:39.827008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:39.828010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:39.829215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 520/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:03:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:39.837363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:39.895405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:39.941984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6bfb1-8f6c-43e0-995b-4ba1d6cb3a55 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:39.977143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59526-55e3-4c93-a6a9-7fc674746881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:39.977706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59526-55e3-4c93-a6a9-7fc674746881 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:39.977969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59526-55e3-4c93-a6a9-7fc674746881 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:39.978264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59526-55e3-4c93-a6a9-7fc674746881 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:39.979043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee59526-55e3-4c93-a6a9-7fc674746881 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:39.979350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee59526-55e3-4c93-a6a9-7fc674746881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:39.980779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee59526-55e3-4c93-a6a9-7fc674746881 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.002280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 519/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:03:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:40.003724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.089417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208c969-f96d-4b2d-b6de-aa4fa3df59db None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.089770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208c969-f96d-4b2d-b6de-aa4fa3df59db None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.089959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208c969-f96d-4b2d-b6de-aa4fa3df59db None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.091514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 520/1040] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:40.096895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fdc09-ddbf-4ec8-b732-8df9d9e0ef79 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.097175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fdc09-ddbf-4ec8-b732-8df9d9e0ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.097443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fdc09-ddbf-4ec8-b732-8df9d9e0ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.098773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:40.108701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbfbd8-dcc8-4c4a-b716-bcf5a68bb221 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.121163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-fc4fdc09-ddbf-4ec8-b732-8df9d9e0ef79 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:40.122386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fc4fdc09-ddbf-4ec8-b732-8df9d9e0ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:40.149494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.150458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.150458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.150691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.200292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 521/1041] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:40.223286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fdc09-ddbf-4ec8-b732-8df9d9e0ef79 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.224459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.227079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.267695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:40.325508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:40.328700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fdc09-ddbf-4ec8-b732-8df9d9e0ef79 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.342556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 521/1042] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 22:03:40.343693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.370464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.371120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.371397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.371671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.372290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.373645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:40.383442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:40.384464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:40.385432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 522/1043] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:40.390390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.453672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cb75c-d91e-4f37-ab89-d8da4b5602ec None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.496402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207055b0-8d8a-4b1e-8f38-8a846e1b8ab8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.498328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.498986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.499269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.499543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.506431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:40.511958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.513417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:40.528698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:40.529642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:40.530581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:40.530581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:40.530581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:40.530581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:40.530581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 522/1044] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:40.535236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.542767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.543383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.543659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.544341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.545018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] RBAC: Adding query filter params (name=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:40.545321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.547173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.554607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 523/1045] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:40.560098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.586287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:40.644653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83dedf-ccde-4d9f-b0b6-9e8ca2e18f88 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.671337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53bbb-6613-4dfd-b0cf-ee5d55a40d71 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.682015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.682657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.682933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.683205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.683882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:40.684182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.685529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.697802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 523/1046] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:40.703038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.708707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.709324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.709597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.709861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.710548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] RBAC: Adding query filter params (type=image) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:40.710848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.712183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.721692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 524/1047] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:40.722881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.757229 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:40.819320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30cce-94d1-427c-9dff-1fdd45ebab09 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.822559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:40.825899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b62d88-2093-46ed-b40a-5fdb8c285109 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:40.858325 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.859601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.860084 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.860551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.863183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:40.863802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:40.864083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:40.864357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:40.865055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.866450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.869406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:40.871205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:40.885157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:40.886192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:40.887801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 524/1048] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:40.902553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:40.902766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 525/1049] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:03:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:03:41.006042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634143f6-1803-46ef-b287-eaa6805bcca3 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:41.054146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2bc7a-e8a6-4f1a-b27f-927b3cf3d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:41.055061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2bc7a-e8a6-4f1a-b27f-927b3cf3d5bd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:41.055343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2bc7a-e8a6-4f1a-b27f-927b3cf3d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:41.055618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2bc7a-e8a6-4f1a-b27f-927b3cf3d5bd None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:41.056366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2bc7a-e8a6-4f1a-b27f-927b3cf3d5bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:41.056670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2bc7a-e8a6-4f1a-b27f-927b3cf3d5bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:41.058095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2bc7a-e8a6-4f1a-b27f-927b3cf3d5bd None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:41.070157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 525/1050] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:41.076167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:41.179933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:41.191292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caddc7d-ccfc-4e43-b503-7967ad248268 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:41.226706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e8c6-37c3-41f3-8bf0-0284e685613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:41.227324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e8c6-37c3-41f3-8bf0-0284e685613d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:41.227600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e8c6-37c3-41f3-8bf0-0284e685613d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:41.227866 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e8c6-37c3-41f3-8bf0-0284e685613d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:41.228651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e8c6-37c3-41f3-8bf0-0284e685613d None admin] RBAC: Adding query filter params (role.id=832a97a7ce404a3a93d7c88f6a6c5716, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=cf0b530da35f445d8241c16d8f51b16b) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:41.228958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e8c6-37c3-41f3-8bf0-0284e685613d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:41.230401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e8c6-37c3-41f3-8bf0-0284e685613d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:41.241546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 526/1051] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:41 2022] GET /identity/v3/role_assignments?user.id=cf0b530da35f445d8241c16d8f51b16b&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=832a97a7ce404a3a93d7c88f6a6c5716 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:41.401599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd58d-970b-4ec2-95c4-a7e6dc9ff808 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:41.401966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd58d-970b-4ec2-95c4-a7e6dc9ff808 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:41.402159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd58d-970b-4ec2-95c4-a7e6dc9ff808 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:41.403674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 526/1052] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:41.409207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d18d-68d5-4279-8ff0-8e45fa812a8b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:41.409491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d18d-68d5-4279-8ff0-8e45fa812a8b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:41.409760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37d18d-68d5-4279-8ff0-8e45fa812a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:41.428811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ce37d18d-68d5-4279-8ff0-8e45fa812a8b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:41.430354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ce37d18d-68d5-4279-8ff0-8e45fa812a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:41.499018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 527/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:41.522027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd58d-970b-4ec2-95c4-a7e6dc9ff808 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:41.545671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:41.628609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd58d-970b-4ec2-95c4-a7e6dc9ff808 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:41.662589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:41.663147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:41.663430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:41.663701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:41.674556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:41.679636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:41.680558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:41.681402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:41.685903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 527/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:41.687170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d18d-68d5-4279-8ff0-8e45fa812a8b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:41.771911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:41.788426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37d18d-68d5-4279-8ff0-8e45fa812a8b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:41.821736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:41.822369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:41.822647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:41.822912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:41.823609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:41.823907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:41.825252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:41.834157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 528/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:41.839799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:41.920683 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:41.941967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21eb30-f9d3-4da4-b6e2-422e0d643850 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:41.976544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:41.977451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:41.977880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:41.978328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] PATH_INFO: `/v3/users/1fd091e9b6554788ad87107accfde667` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:41.992625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] RBAC: Authorizing `identity:get_user(user_id=1fd091e9b6554788ad87107accfde667)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:41.994105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:41.996098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 528/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:41 2022] GET /identity/v3/users/1fd091e9b6554788ad87107accfde667 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:42.003862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:42.111360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1186ba1-14bc-43c2-9dd8-020cb8da110e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:42.149161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:42.149774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:42.150054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:42.150351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:42.165311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:42.220182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:42.221537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:42.318758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 529/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:42.324816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:42.424687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282952a-f4bd-435f-b024-5bbd646cb18d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:42.458391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e531af-7beb-47f9-a835-e564b90c23ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:42.459020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e531af-7beb-47f9-a835-e564b90c23ec None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:42.459295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e531af-7beb-47f9-a835-e564b90c23ec None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:42.459562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e531af-7beb-47f9-a835-e564b90c23ec None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:42.460715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e531af-7beb-47f9-a835-e564b90c23ec None admin] RBAC: Authorizing `identity:get_project(project_id=32251a2eb6554cde9d2cf25fd53bbad5)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:42.462126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e531af-7beb-47f9-a835-e564b90c23ec None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:42.463991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 529/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:03:42 2022] GET /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:42.469819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:42.517395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:42.570426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121248-5e55-4c08-baaa-30f6bed3ad7e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:42.604404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec0b17-ad18-4399-927d-f6b68b85b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:42.605014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0b17-ad18-4399-927d-f6b68b85b1ee None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:42.605285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0b17-ad18-4399-927d-f6b68b85b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:42.605549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0b17-ad18-4399-927d-f6b68b85b1ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:42.606347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec0b17-ad18-4399-927d-f6b68b85b1ee None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5, user.id=1fd091e9b6554788ad87107accfde667) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:42.606649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec0b17-ad18-4399-927d-f6b68b85b1ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:42.608112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec0b17-ad18-4399-927d-f6b68b85b1ee None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:42.614270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 530/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:42 2022] GET /identity/v3/role_assignments?user.id=1fd091e9b6554788ad87107accfde667&scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:42.917400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317282-73b5-417e-ba3a-1b54dded3389 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:42.917783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317282-73b5-417e-ba3a-1b54dded3389 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:42.917960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317282-73b5-417e-ba3a-1b54dded3389 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:42.919458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 530/1060] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:42.924960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb314-0786-41aa-b81f-1c9d3bd30e45 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:42.925245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb314-0786-41aa-b81f-1c9d3bd30e45 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:42.925514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb314-0786-41aa-b81f-1c9d3bd30e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:42.943862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f3aeb314-0786-41aa-b81f-1c9d3bd30e45 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:42.945041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f3aeb314-0786-41aa-b81f-1c9d3bd30e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:43.013904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 531/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:43.035166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317282-73b5-417e-ba3a-1b54dded3389 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:43.044045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:43.140966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317282-73b5-417e-ba3a-1b54dded3389 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:43.175406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:43.175946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.176220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.176496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.247667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:43.248913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f2f24-473b-49f6-bf22-54239a4a9cf4 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.249123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:43.249226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f2f24-473b-49f6-bf22-54239a4a9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.249449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f2f24-473b-49f6-bf22-54239a4a9cf4 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.251073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 532/1062] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:43.255873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19c54-6c8b-407a-b837-ed11536427bb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.256156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19c54-6c8b-407a-b837-ed11536427bb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.256424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19c54-6c8b-407a-b837-ed11536427bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.257799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:43.274698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-23c19c54-6c8b-407a-b837-ed11536427bb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:43.275882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-23c19c54-6c8b-407a-b837-ed11536427bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:43.314872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:43.349480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 533/1063] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:43.357271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 531/1064] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:43.359161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19c54-6c8b-407a-b837-ed11536427bb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:43.371572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:43.460900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19c54-6c8b-407a-b837-ed11536427bb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:43.479639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715cdb-6d7b-4160-99b7-8dc952e62e49 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:43.487023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:43.497129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:43.497766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.498044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.498342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.509049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:43.510502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:43.515333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:43.515965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.516239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.516557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:43.526025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:43.526971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:43.533420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:43.533420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:43.533420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:43.533420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:43.533420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 534/1065] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:43.534889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:43.535124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:43.539857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:43.540845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 532/1066] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 28 22:03:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:43.547224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:43.560331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:43.641325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f558b55-e397-43fc-b951-34dbd629e54b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:43.654145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4ce76-f627-4d43-9f73-da3db9d9bb28 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:43.678252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:43.678983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.679263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.679537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.680225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:43.680531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:43.682132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:43.689120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:43.689847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.690126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.690427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.691148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:43.691459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:43.692840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:43.702345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 533/1067] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 28 22:03:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:43.706259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 535/1068] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:43.709084 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:43.740419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:43.820108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5187-8d58-4542-afa4-0656d08e37d6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:43.855226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:43.855872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:43.856151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:43.856422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:43.867833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:43.869562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:43.885206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:43.886133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:43.888379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:43.888379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:43.888379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:43.888379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:43.888379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 534/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:43.894689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:43.983514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:44.002873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c704-f949-49d7-9dce-cd8d7614a51c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.036543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:44.037169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.037418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.037682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.038385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:44.038683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:44.040034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:44.050858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 536/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:44.056639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.139519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:44.159048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e4330-1a51-4dc1-819d-fd8b7fcc1c0e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.191879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:44.192520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.192802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.193074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.200588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:44.202014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:44.213774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:44.214865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:44.215821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 535/1071] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:44.220666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.328071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884a2a-f663-4a0e-b80f-8f5b26eca1f8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.360264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:44.361408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.361685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.361950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.362770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:44.363073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:44.364489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:44.378782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:44.382818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 537/1072] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:44.388087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.484115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf86487-b8c6-47b7-b748-cde241ff5985 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.518066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7cdcc-2942-41e6-83ca-7b1dc56fc4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:44.518724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cdcc-2942-41e6-83ca-7b1dc56fc4ef None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.519005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cdcc-2942-41e6-83ca-7b1dc56fc4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.519273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cdcc-2942-41e6-83ca-7b1dc56fc4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.527708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:44.530027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7cdcc-2942-41e6-83ca-7b1dc56fc4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:44.531800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7cdcc-2942-41e6-83ca-7b1dc56fc4ef None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-41b7cdcc-2942-41e6-83ca-7b1dc56fc4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:44.545686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:44.546654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:44.547589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:44.547589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:44.547589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:44.547589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:44.547589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 536/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:44.553003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.608243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85baec8-18a3-4914-bd33-8984c97289b8 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.608436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85baec8-18a3-4914-bd33-8984c97289b8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.608707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85baec8-18a3-4914-bd33-8984c97289b8 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.610091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 537/1074] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:44.615981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0eae7-eca2-42fb-a243-240033c6b08f None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.616422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0eae7-eca2-42fb-a243-240033c6b08f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.616704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0eae7-eca2-42fb-a243-240033c6b08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.634614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-18b0eae7-eca2-42fb-a243-240033c6b08f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:44.635816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-18b0eae7-eca2-42fb-a243-240033c6b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:44.652554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7b367-b4c5-49b4-8df9-d1dbe0906ec0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.689977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:44.690625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.690902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.691170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.691858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:44.692159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:44.693516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:44.704484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 538/1075] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:44.706616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 538/1076] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:44.710279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.728660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0eae7-eca2-42fb-a243-240033c6b08f None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.768420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:44.810126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6abd4-8282-451a-88bb-647dab644be3 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.826799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0eae7-eca2-42fb-a243-240033c6b08f None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.842345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:44.842975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.843247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.843513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.849434 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:44.850730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:44.852297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:44.861738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:44.862331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:44.862613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:44.862885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:44.864157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:44.865157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:44.866096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 539/1077] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:44.871008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.878846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:44.883710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:44.884772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 539/1078] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:44.890718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:44.968052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162484d-8990-4c8e-a030-8c7a45b9e16b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:44.987644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:44.988722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3082e-41d3-41b8-922b-f652c23967f9 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:45.001752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:45.002680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:45.002942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:45.003225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:45.003961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:45.004267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:45.005707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:45.017985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 540/1079] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:45.023985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:45.025609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:45.026224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:45.026524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:45.026792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:45.027495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:45.027795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:45.029146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:45.038324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 540/1080] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:45.043941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:45.087685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:45.124121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4468bd-0556-4da4-b202-b80b63ad3447 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:45.143858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f486-7613-4af6-8fa7-89cc5d40b44d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:45.161067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:45.161720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:45.161995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:45.162285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/cf0b530da35f445d8241c16d8f51b16b/roles/832a97a7ce404a3a93d7c88f6a6c5716` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:45.164432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=cf0b530da35f445d8241c16d8f51b16b, role_id=832a97a7ce404a3a93d7c88f6a6c5716)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:45.165852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:45.177917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:45.178599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:45.178880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:45.179157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] PATH_INFO: `/v3/users/1fd091e9b6554788ad87107accfde667` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:45.179402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 541/1081] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:03:45 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/cf0b530da35f445d8241c16d8f51b16b/roles/832a97a7ce404a3a93d7c88f6a6c5716 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:03:45.180350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] RBAC: Authorizing `identity:get_user(user_id=1fd091e9b6554788ad87107accfde667)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:45.181778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:45.183469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 541/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:45 2022] GET /identity/v3/users/1fd091e9b6554788ad87107accfde667 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:45.189456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:45.234963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:45.296373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2bb57-4858-40ec-a20f-ab6bce4df9df None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:45.338759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e6683-87d6-49ba-9c21-a81a419e83d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:45.339498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e6683-87d6-49ba-9c21-a81a419e83d4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:45.339800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e6683-87d6-49ba-9c21-a81a419e83d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:45.340064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e6683-87d6-49ba-9c21-a81a419e83d4 None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:45.341233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e6683-87d6-49ba-9c21-a81a419e83d4 None admin] RBAC: Authorizing `identity:get_project(project_id=32251a2eb6554cde9d2cf25fd53bbad5)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:45.342694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e6683-87d6-49ba-9c21-a81a419e83d4 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:45.344357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 542/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:03:45 2022] GET /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:45.350464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:45.450576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d337-26fb-4532-950f-6d172cdefb77 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:45.464487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:45.485679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f7bb-390f-44f1-9df4-76d857c4f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:45.486384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f7bb-390f-44f1-9df4-76d857c4f6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:45.486665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f7bb-390f-44f1-9df4-76d857c4f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:45.486939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f7bb-390f-44f1-9df4-76d857c4f6a6 None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5/users/1fd091e9b6554788ad87107accfde667/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:45.488869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f7bb-390f-44f1-9df4-76d857c4f6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=32251a2eb6554cde9d2cf25fd53bbad5, user_id=1fd091e9b6554788ad87107accfde667, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:45.490326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f7bb-390f-44f1-9df4-76d857c4f6a6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:45.503386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 542/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:03:45 2022] PUT /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5/users/1fd091e9b6554788ad87107accfde667/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:03:47.140468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eac14-fb09-438a-ae14-d77b96b9f569 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.140856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eac14-fb09-438a-ae14-d77b96b9f569 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.141006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eac14-fb09-438a-ae14-d77b96b9f569 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.142926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 543/1085] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:47.148059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1fe9-b5c1-4c6a-825b-4be9ae978d27 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.148438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1fe9-b5c1-4c6a-825b-4be9ae978d27 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.148604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1fe9-b5c1-4c6a-825b-4be9ae978d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.166358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-aeab1fe9-b5c1-4c6a-825b-4be9ae978d27 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:47.167536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-aeab1fe9-b5c1-4c6a-825b-4be9ae978d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:47.231007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 543/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:47.254662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eac14-fb09-438a-ae14-d77b96b9f569 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.353404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eac14-fb09-438a-ae14-d77b96b9f569 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:47.362954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:47.388111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba443f-40da-487b-a7d2-15167a327607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:47.388677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba443f-40da-487b-a7d2-15167a327607 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.388951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba443f-40da-487b-a7d2-15167a327607 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.389217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba443f-40da-487b-a7d2-15167a327607 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.399895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba443f-40da-487b-a7d2-15167a327607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-17ba443f-40da-487b-a7d2-15167a327607 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:47.404680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:47.405772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:47.406687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 544/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:47.411770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1fe9-b5c1-4c6a-825b-4be9ae978d27 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.476878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24982-220d-49ed-9e3d-0f1f5944d86b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.477153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24982-220d-49ed-9e3d-0f1f5944d86b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.477420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24982-220d-49ed-9e3d-0f1f5944d86b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.478794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 545/1088] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:03:47.483570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd442b0-0b05-4f42-8a3e-724015221100 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.483849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd442b0-0b05-4f42-8a3e-724015221100 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.484121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd442b0-0b05-4f42-8a3e-724015221100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.502783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1cd442b0-0b05-4f42-8a3e-724015221100 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:47.503967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1cd442b0-0b05-4f42-8a3e-724015221100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:47.515154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1fe9-b5c1-4c6a-825b-4be9ae978d27 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:47.516703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:47.550989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:47.551644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.551923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.552198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.552918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:47.553225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:47.554679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:47.562629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 544/1089] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:47.568748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.570510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 546/1090] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:03:47.592596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd442b0-0b05-4f42-8a3e-724015221100 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.667160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3600bd-5ecc-4661-a3f7-3d1849e53e77 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:47.685107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:47.689136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd442b0-0b05-4f42-8a3e-724015221100 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:47.703498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:47.704139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.704425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.704701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.715182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:47.716609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:47.722097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:47.722767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.723055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.723325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:47.731167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:47.732091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:47.733006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:47.733006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:47.733006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:47.733006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:47.733006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 545/1091] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:47.734356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:03:47.738492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:03:47.740016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:47.741120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:03:47.742027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 547/1092] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:47.746940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.758666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:47.840962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb703a3-cb96-4ffa-949d-34c483d15a93 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:47.848612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd30ba2-a9b3-45ab-a974-384b97d2087c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:47.874717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:47.875333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.875612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.875891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.876601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:47.876914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:47.878574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:47.881685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:47.882316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:47.882594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:47.882862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:47.883557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:47.883854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:47.885188 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:47.890009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 546/1093] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:47.894511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 548/1094] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:47.896297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.899005 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:47.921397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:47.973063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:47.996692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813f3c-c9af-4e40-b610-1d2ef6ad2633 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:47.998860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ac075-fea7-4037-8537-4385c12d2a40 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.030333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.030981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.031259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.031532 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.031646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.032158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.033003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.033269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] PATH_INFO: `/v3/users/1fd091e9b6554788ad87107accfde667` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.034460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] RBAC: Authorizing `identity:get_user(user_id=1fd091e9b6554788ad87107accfde667)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.035871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.037654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 549/1095] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/users/1fd091e9b6554788ad87107accfde667 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:48.039252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.040686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.043107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:03:48.052800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:48.053810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:48.055125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 547/1096] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 28 22:03:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:48.059381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.133022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:48.145799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69dee6-2ce0-4031-a395-6b0bfb938593 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.162029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79306a89-03d5-4567-ad4e-a2e9fbddfcb6 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.180204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.180763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.181044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.181339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.195396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.196116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.196415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.196688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.197516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:48.197826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.199302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.202694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:48.219516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 548/1097] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:48.225297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.256912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.258414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.325406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62fa7e-a558-46e1-9f7e-a1d75e8ddcae None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.342039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:48.354859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 550/1098] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 22:03:48.360239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.360629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.360899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.361180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.361456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.421606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:48.432205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.433589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.459594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36305cf1-f55d-4f04-9068-f4fef9077278 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.492103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.492727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.493001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.493289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.494528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] RBAC: Authorizing `identity:get_project(project_id=32251a2eb6554cde9d2cf25fd53bbad5)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.495943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.497694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 551/1099] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:48.505398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.532863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 549/1100] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 22:03:48.539549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.562542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:48.605606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f438-31c6-4483-9019-1cbda789ee58 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.630752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:48.637846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1a220-7b9b-4cdc-afba-9bf2bed6cd33 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.639252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.639878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.640144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.640408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.641184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5, user.id=1fd091e9b6554788ad87107accfde667) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:48.641490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.643514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.649334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 552/1101] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/role_assignments?user.id=1fd091e9b6554788ad87107accfde667&scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:03:48.672836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.673504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.673785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.674058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.685524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.687001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:03:48.703526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:48.705251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:48.706166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:03:48.706166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:03:48.706166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:03:48.706166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:48.706166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 550/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:03:48.711335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.821540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfab12c-58ea-4cfa-b757-6ddddf4c8d88 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:48.848332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:48.863215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:48.863827 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:48.864101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:48.864364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:48.865043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:48.865339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:48.866735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:48.879207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 553/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:48.884899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:48.982904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683942a-4e69-4753-8d2c-5f7edd1f8f2b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:49.018034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:49.018697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:49.018976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:49.019249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:49.025956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:49.027450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:03:49.038814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:03:49.039681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:03:49.040570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 551/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:03:49.045740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:49.149895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c732b7-bbe7-4bca-adc6-75425395fc6f None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:49.183554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2845d37-42b3-4c66-bdf5-d47cad457940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:49.184166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2845d37-42b3-4c66-bdf5-d47cad457940 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:49.184445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2845d37-42b3-4c66-bdf5-d47cad457940 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:49.184717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2845d37-42b3-4c66-bdf5-d47cad457940 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:49.185454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2845d37-42b3-4c66-bdf5-d47cad457940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:49.185759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2845d37-42b3-4c66-bdf5-d47cad457940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:49.187211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2845d37-42b3-4c66-bdf5-d47cad457940 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:49.199076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 554/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:49.205103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:49.214217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:49.304164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05833-1e1e-4805-9aab-bce879fc99ee None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:49.338511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe76fa-6f02-44e8-98a4-808735f66467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:49.339120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe76fa-6f02-44e8-98a4-808735f66467 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:49.339393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe76fa-6f02-44e8-98a4-808735f66467 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:49.339660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe76fa-6f02-44e8-98a4-808735f66467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:49.340431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe76fa-6f02-44e8-98a4-808735f66467 None admin] RBAC: Adding query filter params (role.id=832a97a7ce404a3a93d7c88f6a6c5716, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=cf0b530da35f445d8241c16d8f51b16b) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:49.340735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe76fa-6f02-44e8-98a4-808735f66467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:49.342151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe76fa-6f02-44e8-98a4-808735f66467 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:49.347793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 552/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:49 2022] GET /identity/v3/role_assignments?user.id=cf0b530da35f445d8241c16d8f51b16b&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=832a97a7ce404a3a93d7c88f6a6c5716 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:50.656928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff90f2-ca17-4a7b-8dee-5637a655673c None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:50.657454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff90f2-ca17-4a7b-8dee-5637a655673c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:50.657454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff90f2-ca17-4a7b-8dee-5637a655673c None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:50.658876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 555/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:50.663901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4c76-2a59-4116-99ed-c1597057d2d7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:50.664279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4c76-2a59-4116-99ed-c1597057d2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:50.664458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4c76-2a59-4116-99ed-c1597057d2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:50.682833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-face4c76-2a59-4116-99ed-c1597057d2d7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:50.684007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-face4c76-2a59-4116-99ed-c1597057d2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:50.744834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:50.750372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 553/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:50.774660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff90f2-ca17-4a7b-8dee-5637a655673c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:50.816299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:50.872569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff90f2-ca17-4a7b-8dee-5637a655673c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:50.905296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132ccf5-10c5-4ee3-8b2c-1db5bf5d60af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:50.905917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ccf5-10c5-4ee3-8b2c-1db5bf5d60af None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:50.906198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ccf5-10c5-4ee3-8b2c-1db5bf5d60af None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:50.906496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ccf5-10c5-4ee3-8b2c-1db5bf5d60af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:50.907675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132ccf5-10c5-4ee3-8b2c-1db5bf5d60af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:50.909043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132ccf5-10c5-4ee3-8b2c-1db5bf5d60af None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:50.910639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 556/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:50.916128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face4c76-2a59-4116-99ed-c1597057d2d7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:51.011339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face4c76-2a59-4116-99ed-c1597057d2d7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:51.043018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627d0da-643f-4808-8416-ae1661917c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:51.043617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d0da-643f-4808-8416-ae1661917c21 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:51.043893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d0da-643f-4808-8416-ae1661917c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:51.044161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d0da-643f-4808-8416-ae1661917c21 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:51.044834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627d0da-643f-4808-8416-ae1661917c21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:51.046270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627d0da-643f-4808-8416-ae1661917c21 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:51.067204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 554/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:03:50 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:03:53.083110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f000d6a-2dcd-4a79-b3ef-98bc2ade4237 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:53.083643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f000d6a-2dcd-4a79-b3ef-98bc2ade4237 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:53.083643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f000d6a-2dcd-4a79-b3ef-98bc2ade4237 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:53.084996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 557/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:53.090083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a822b-c278-4303-9a05-e75c1f4ea47e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:53.090517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a822b-c278-4303-9a05-e75c1f4ea47e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:53.090692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a822b-c278-4303-9a05-e75c1f4ea47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:53.109171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c55a822b-c278-4303-9a05-e75c1f4ea47e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:53.110986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c55a822b-c278-4303-9a05-e75c1f4ea47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:53.159923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:53.177738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 555/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:53.200457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f000d6a-2dcd-4a79-b3ef-98bc2ade4237 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:53.301436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f000d6a-2dcd-4a79-b3ef-98bc2ade4237 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:53.310107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:53.334738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:53.335309 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:53.335586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:53.335855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] PATH_INFO: `/v3/roles/16d20d9321574453897849a9f649b636` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:53.337284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] RBAC: Authorizing `identity:get_role(role_id=16d20d9321574453897849a9f649b636)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:53.338679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:53.340004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 558/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:53 2022] GET /identity/v3/roles/16d20d9321574453897849a9f649b636 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:53.346720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a822b-c278-4303-9a05-e75c1f4ea47e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:53.441338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a822b-c278-4303-9a05-e75c1f4ea47e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:53.474089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:53.474739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:53.475014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:53.475282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] PATH_INFO: `/v3/users/2bc676cd7e2e4913b27a474d338cf652` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:53.487592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] RBAC: Authorizing `identity:get_user(user_id=2bc676cd7e2e4913b27a474d338cf652)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:53.489010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:53.490603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 556/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:53 2022] GET /identity/v3/users/2bc676cd7e2e4913b27a474d338cf652 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:53.496577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:53.599895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b93e68-1685-484f-b7ee-0232854f6bc1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:53.632368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:53.632977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:53.633255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:53.633524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:53.678602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:53.700938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:53.702435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:53.798398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 559/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:53.804300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:53.848550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:53.901708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c4cd6-d53a-4484-a7e6-10177801ca33 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:53.936943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef4af-7e97-4a5b-a2ae-b6cc3d81beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:53.937567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef4af-7e97-4a5b-a2ae-b6cc3d81beed None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:53.937850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef4af-7e97-4a5b-a2ae-b6cc3d81beed None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:53.938125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef4af-7e97-4a5b-a2ae-b6cc3d81beed None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:53.939817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef4af-7e97-4a5b-a2ae-b6cc3d81beed None admin] RBAC: Authorizing `identity:get_project(project_id=32251a2eb6554cde9d2cf25fd53bbad5)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:53.941246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef4af-7e97-4a5b-a2ae-b6cc3d81beed None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:53.942948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 557/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:03:53 2022] GET /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:53.949591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:54.022824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:54.044884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a97c-a310-47e6-ba89-c33d1ee1314e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:54.078023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d32d9-09c8-41f7-bcd2-1b49e4ffa3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:54.078653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d32d9-09c8-41f7-bcd2-1b49e4ffa3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:54.078935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d32d9-09c8-41f7-bcd2-1b49e4ffa3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:54.079237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d32d9-09c8-41f7-bcd2-1b49e4ffa3d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:54.080007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d32d9-09c8-41f7-bcd2-1b49e4ffa3d5 None admin] RBAC: Adding query filter params (role.id=16d20d9321574453897849a9f649b636, scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5, user.id=2bc676cd7e2e4913b27a474d338cf652) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:54.080314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d32d9-09c8-41f7-bcd2-1b49e4ffa3d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:54.081740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d32d9-09c8-41f7-bcd2-1b49e4ffa3d5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:54.086933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 560/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:53 2022] GET /identity/v3/role_assignments?user.id=2bc676cd7e2e4913b27a474d338cf652&scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5&role.id=16d20d9321574453897849a9f649b636 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:56.040757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf91d3-4c00-46e0-8399-c63bb1709947 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:56.041356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf91d3-4c00-46e0-8399-c63bb1709947 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:56.041356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf91d3-4c00-46e0-8399-c63bb1709947 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:56.042662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 558/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:56.048292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba091-f295-4172-93e1-825c942807e1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:56.048683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba091-f295-4172-93e1-825c942807e1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:56.048834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ba091-f295-4172-93e1-825c942807e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:56.066290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-655ba091-f295-4172-93e1-825c942807e1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:56.067478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-655ba091-f295-4172-93e1-825c942807e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:56.131293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 561/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:56.152451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf91d3-4c00-46e0-8399-c63bb1709947 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:56.252683 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf91d3-4c00-46e0-8399-c63bb1709947 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:56.266031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:56.287607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:56.288234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:56.288514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:56.288789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] PATH_INFO: `/v3/roles/16d20d9321574453897849a9f649b636` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:56.290244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] RBAC: Authorizing `identity:get_role(role_id=16d20d9321574453897849a9f649b636)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:56.291665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:56.292932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 559/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:56 2022] GET /identity/v3/roles/16d20d9321574453897849a9f649b636 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:56.298682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba091-f295-4172-93e1-825c942807e1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:56.364325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:56.394527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ba091-f295-4172-93e1-825c942807e1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:56.426894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:56.427529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:56.427807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:56.428078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] PATH_INFO: `/v3/users/2bc676cd7e2e4913b27a474d338cf652` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:56.429233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] RBAC: Authorizing `identity:get_user(user_id=2bc676cd7e2e4913b27a474d338cf652)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:56.430690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:56.432274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 562/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:56 2022] GET /identity/v3/users/2bc676cd7e2e4913b27a474d338cf652 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:56.437918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:56.534459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df033-caca-486c-a7e1-f852e3dba4d5 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:56.567239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc1181-9c89-48ee-8c64-c9c07a0573e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:56.567803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc1181-9c89-48ee-8c64-c9c07a0573e4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:56.568078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc1181-9c89-48ee-8c64-c9c07a0573e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:56.568346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc1181-9c89-48ee-8c64-c9c07a0573e4 None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:56.569479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc1181-9c89-48ee-8c64-c9c07a0573e4 None admin] RBAC: Authorizing `identity:get_project(project_id=32251a2eb6554cde9d2cf25fd53bbad5)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:56.570919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc1181-9c89-48ee-8c64-c9c07a0573e4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:56.572546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 560/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:03:56 2022] GET /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:56.578157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:56.674974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fcb5c-1503-4421-85d0-84bb0fb20a72 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:56.708379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fb72d-cb6a-4f2b-8ec1-3a108f9766e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:56.709027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fb72d-cb6a-4f2b-8ec1-3a108f9766e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:56.709308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fb72d-cb6a-4f2b-8ec1-3a108f9766e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:56.709580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fb72d-cb6a-4f2b-8ec1-3a108f9766e1 None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5/users/2bc676cd7e2e4913b27a474d338cf652/roles/16d20d9321574453897849a9f649b636` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:56.711761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fb72d-cb6a-4f2b-8ec1-3a108f9766e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=32251a2eb6554cde9d2cf25fd53bbad5, user_id=2bc676cd7e2e4913b27a474d338cf652, role_id=16d20d9321574453897849a9f649b636)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:56.713171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fb72d-cb6a-4f2b-8ec1-3a108f9766e1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:56.720787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:56.726398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 563/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:03:56 2022] PUT /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5/users/2bc676cd7e2e4913b27a474d338cf652/roles/16d20d9321574453897849a9f649b636 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:03:58.664666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bceb32-0354-44d4-9191-193e0516f157 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:58.665255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bceb32-0354-44d4-9191-193e0516f157 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:58.665255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bceb32-0354-44d4-9191-193e0516f157 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:58.666544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 561/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:03:58.671502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ea41-8373-46d0-ab52-af389e632712 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:58.671933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ea41-8373-46d0-ab52-af389e632712 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:58.672040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ea41-8373-46d0-ab52-af389e632712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:58.690791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-faa7ea41-8373-46d0-ab52-af389e632712 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:03:58.691966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-faa7ea41-8373-46d0-ab52-af389e632712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:03:58.756160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 564/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:03:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:03:58.778513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bceb32-0354-44d4-9191-193e0516f157 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:58.826911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:58.876182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bceb32-0354-44d4-9191-193e0516f157 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:58.909127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:58.909758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:58.910036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:58.910335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] PATH_INFO: `/v3/roles/16d20d9321574453897849a9f649b636` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:58.911766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] RBAC: Authorizing `identity:get_role(role_id=16d20d9321574453897849a9f649b636)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:58.913138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:58.914486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 562/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:58 2022] GET /identity/v3/roles/16d20d9321574453897849a9f649b636 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:58.920295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ea41-8373-46d0-ab52-af389e632712 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:59.015558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ea41-8373-46d0-ab52-af389e632712 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:59.040435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:59.049117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:59.049742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:59.050014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:59.050304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] PATH_INFO: `/v3/users/2bc676cd7e2e4913b27a474d338cf652` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:59.051438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] RBAC: Authorizing `identity:get_user(user_id=2bc676cd7e2e4913b27a474d338cf652)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:59.052918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:59.054500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 565/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:03:58 2022] GET /identity/v3/users/2bc676cd7e2e4913b27a474d338cf652 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:59.060155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:59.157479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c8198-f5d2-464a-b4c4-ce3febc319f4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:59.173671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:59.191032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:59.191637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:59.191914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:59.192181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:59.255727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:59.257153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:59.350183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 563/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:03:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:03:59.356107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:59.450419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880dc73-bde6-484c-8830-2b90729a5143 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:59.483315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df9010-ef19-4902-8423-03c8aecdd064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:59.483939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9010-ef19-4902-8423-03c8aecdd064 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:59.484214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9010-ef19-4902-8423-03c8aecdd064 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:59.484481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9010-ef19-4902-8423-03c8aecdd064 None admin] PATH_INFO: `/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:59.485642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df9010-ef19-4902-8423-03c8aecdd064 None admin] RBAC: Authorizing `identity:get_project(project_id=32251a2eb6554cde9d2cf25fd53bbad5)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:59.487082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df9010-ef19-4902-8423-03c8aecdd064 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:59.488697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 566/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:03:59 2022] GET /identity/v3/projects/32251a2eb6554cde9d2cf25fd53bbad5 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:03:59.494754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:03:59.511758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:03:59.594937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902454-5228-4c52-b301-be4462aaf52d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:03:59.627614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce1c61-b933-4f35-8bdb-a9930feb1f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:03:59.628208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce1c61-b933-4f35-8bdb-a9930feb1f6c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:03:59.628484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce1c61-b933-4f35-8bdb-a9930feb1f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:03:59.628754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce1c61-b933-4f35-8bdb-a9930feb1f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:03:59.629517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce1c61-b933-4f35-8bdb-a9930feb1f6c None admin] RBAC: Adding query filter params (role.id=16d20d9321574453897849a9f649b636, scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5, user.id=2bc676cd7e2e4913b27a474d338cf652) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:03:59.629819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce1c61-b933-4f35-8bdb-a9930feb1f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:03:59.631258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce1c61-b933-4f35-8bdb-a9930feb1f6c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:03:59.636766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 564/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:03:59 2022] GET /identity/v3/role_assignments?user.id=2bc676cd7e2e4913b27a474d338cf652&scope.project.id=32251a2eb6554cde9d2cf25fd53bbad5&role.id=16d20d9321574453897849a9f649b636 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:01.702019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707d80-ccac-4dbf-9ef6-7b0b2c9284e9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:01.702600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707d80-ccac-4dbf-9ef6-7b0b2c9284e9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:01.702600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707d80-ccac-4dbf-9ef6-7b0b2c9284e9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:01.703973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 567/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:01.709116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835fa1-9b6f-4253-adc5-3dc15584d5eb None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:01.709547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835fa1-9b6f-4253-adc5-3dc15584d5eb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:01.709694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835fa1-9b6f-4253-adc5-3dc15584d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:01.728139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d3835fa1-9b6f-4253-adc5-3dc15584d5eb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:01.729332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d3835fa1-9b6f-4253-adc5-3dc15584d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:01.794994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 565/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:01.818058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707d80-ccac-4dbf-9ef6-7b0b2c9284e9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:01.879997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:01.917226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707d80-ccac-4dbf-9ef6-7b0b2c9284e9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:01.949760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2be9d4-d66f-4880-99d2-c72aa4387690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:01.950410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be9d4-d66f-4880-99d2-c72aa4387690 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:01.950699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be9d4-d66f-4880-99d2-c72aa4387690 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:01.950969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be9d4-d66f-4880-99d2-c72aa4387690 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:01.952153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2be9d4-d66f-4880-99d2-c72aa4387690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:01.953545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2be9d4-d66f-4880-99d2-c72aa4387690 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:01.955134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 568/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:01.960837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3835fa1-9b6f-4253-adc5-3dc15584d5eb None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:01.972664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:02.058369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3835fa1-9b6f-4253-adc5-3dc15584d5eb None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:02.090379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128a36-ad6a-47ba-9192-30323bbe185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:02.090988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128a36-ad6a-47ba-9192-30323bbe185d None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:02.091267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128a36-ad6a-47ba-9192-30323bbe185d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:02.091538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128a36-ad6a-47ba-9192-30323bbe185d None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:02.092217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128a36-ad6a-47ba-9192-30323bbe185d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:02.093639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128a36-ad6a-47ba-9192-30323bbe185d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:02.120427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 566/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:04:01 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:04:04.115469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdb351-a700-48fc-9c8a-a2b60407a258 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:04.116017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdb351-a700-48fc-9c8a-a2b60407a258 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:04.116017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdb351-a700-48fc-9c8a-a2b60407a258 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:04.117360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 569/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:04.122588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a0f9-e81d-4a21-8d0c-1fdd273e2c3e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:04.123006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a0f9-e81d-4a21-8d0c-1fdd273e2c3e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:04.123146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a0f9-e81d-4a21-8d0c-1fdd273e2c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:04.141212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ac17a0f9-e81d-4a21-8d0c-1fdd273e2c3e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:04.142496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ac17a0f9-e81d-4a21-8d0c-1fdd273e2c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:04.196992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:04.208153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 567/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:04.231906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdb351-a700-48fc-9c8a-a2b60407a258 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:04.329377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdb351-a700-48fc-9c8a-a2b60407a258 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:04.356986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:04.362164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02be15c-19a3-4dd1-8082-0c14d063b00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:04.362813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02be15c-19a3-4dd1-8082-0c14d063b00e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:04.363088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02be15c-19a3-4dd1-8082-0c14d063b00e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:04.363354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02be15c-19a3-4dd1-8082-0c14d063b00e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:04.364466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02be15c-19a3-4dd1-8082-0c14d063b00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:04.365921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02be15c-19a3-4dd1-8082-0c14d063b00e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:04.367528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 570/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:04.373267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17a0f9-e81d-4a21-8d0c-1fdd273e2c3e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:04.468852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17a0f9-e81d-4a21-8d0c-1fdd273e2c3e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:04.501752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e3dcc-cd1f-4621-9231-905328540657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:04.502635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3dcc-cd1f-4621-9231-905328540657 None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:04.502914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3dcc-cd1f-4621-9231-905328540657 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:04.503187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3dcc-cd1f-4621-9231-905328540657 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:04.503864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e3dcc-cd1f-4621-9231-905328540657 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:04.505312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e3dcc-cd1f-4621-9231-905328540657 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:04.525560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 568/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:04:04 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:04:06.511939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33292-e2fd-4fb3-86dd-e6230b47b38e None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:06.512458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33292-e2fd-4fb3-86dd-e6230b47b38e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:06.512458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33292-e2fd-4fb3-86dd-e6230b47b38e None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:06.513742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 571/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:06.519312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120030-d974-4cee-ae3a-7843c7c03191 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:06.519697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120030-d974-4cee-ae3a-7843c7c03191 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:06.519864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120030-d974-4cee-ae3a-7843c7c03191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:06.537443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-81120030-d974-4cee-ae3a-7843c7c03191 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:06.538668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-81120030-d974-4cee-ae3a-7843c7c03191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:06.581251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:06.605376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 569/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:06.628524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33292-e2fd-4fb3-86dd-e6230b47b38e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:06.726344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33292-e2fd-4fb3-86dd-e6230b47b38e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:06.758731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:06.759349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:06.759625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:06.759895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:06.771238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:04:06.778038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:04:06.779239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:04:06.780176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 572/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:04:06.785863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120030-d974-4cee-ae3a-7843c7c03191 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:06.880978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120030-d974-4cee-ae3a-7843c7c03191 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:06.914416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:06.915024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:06.915307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:06.915583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:06.916293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:06.916598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:06.917965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:06.925796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 570/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:06.931370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:06.988767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:07.028484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e806d25-19cb-4131-b856-1cf2f078dcb0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:07.061688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:07.062342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:07.062623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:07.063423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] PATH_INFO: `/v3/users/a6aa8184f95b49798645a96239787c7e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:07.075974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] RBAC: Authorizing `identity:get_user(user_id=a6aa8184f95b49798645a96239787c7e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:07.077402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:07.079587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 573/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:04:06 2022] GET /identity/v3/users/a6aa8184f95b49798645a96239787c7e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:07.085194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:07.127799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:07.183806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8aef6-cc2b-4050-97d2-551679b43b37 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:07.216363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:07.216966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:07.217238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:07.217505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:07.281788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:07.283183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:07.321027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:07.378244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 571/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:04:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:04:07.384092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:07.478869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cbbff-7861-4f11-ae8f-ac74cd39ecf9 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:07.495435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:07.512377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477a301-eae4-4d98-b8ea-078f307ea7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:07.513001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477a301-eae4-4d98-b8ea-078f307ea7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:07.513273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477a301-eae4-4d98-b8ea-078f307ea7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:07.513539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477a301-eae4-4d98-b8ea-078f307ea7f1 None admin] PATH_INFO: `/v3/projects/b3aab705c3dd41658053c6c3307332c2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:07.514694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477a301-eae4-4d98-b8ea-078f307ea7f1 None admin] RBAC: Authorizing `identity:get_project(project_id=b3aab705c3dd41658053c6c3307332c2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:07.516151 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477a301-eae4-4d98-b8ea-078f307ea7f1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:07.517759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 574/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:04:07 2022] GET /identity/v3/projects/b3aab705c3dd41658053c6c3307332c2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:07.523617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:07.621729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badbc2-5baf-4b1f-b4eb-624e946d2b97 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:07.654506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9586a88-e071-4774-b685-647038457db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:07.655106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9586a88-e071-4774-b685-647038457db8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:07.655380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9586a88-e071-4774-b685-647038457db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:07.655646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9586a88-e071-4774-b685-647038457db8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:07.656412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9586a88-e071-4774-b685-647038457db8 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=b3aab705c3dd41658053c6c3307332c2, user.id=a6aa8184f95b49798645a96239787c7e) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:07.656741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9586a88-e071-4774-b685-647038457db8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:07.658149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9586a88-e071-4774-b685-647038457db8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:07.663432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 572/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:04:07 2022] GET /identity/v3/role_assignments?user.id=a6aa8184f95b49798645a96239787c7e&scope.project.id=b3aab705c3dd41658053c6c3307332c2&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:09.596798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830042e0-394e-4853-9e1e-1e3b49682a07 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:09.597306 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830042e0-394e-4853-9e1e-1e3b49682a07 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:09.597394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830042e0-394e-4853-9e1e-1e3b49682a07 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:09.598725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 575/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:09.603690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49422f91-9860-4021-96a5-392876a2d5b4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:09.604112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49422f91-9860-4021-96a5-392876a2d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:09.604218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49422f91-9860-4021-96a5-392876a2d5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:09.612080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:09.622670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-49422f91-9860-4021-96a5-392876a2d5b4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:09.623843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-49422f91-9860-4021-96a5-392876a2d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:09.690628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 573/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:09.712846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830042e0-394e-4853-9e1e-1e3b49682a07 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:09.809317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830042e0-394e-4853-9e1e-1e3b49682a07 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:09.841195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:09.841806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:09.842079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:09.842375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:09.852563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:04:09.857274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:04:09.858396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:04:09.859260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 576/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:04:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:04:09.864294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49422f91-9860-4021-96a5-392876a2d5b4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:09.958663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49422f91-9860-4021-96a5-392876a2d5b4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:09.993073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:09.993681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:09.993958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:09.994225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:09.994952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:09.995251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:09.996604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:09.997920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:10.006117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 574/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:10.011907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:10.057153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:10.111205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e87f-7ca4-4a72-a2e4-158fe626986d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:10.144520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:10.145142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:10.145420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:10.145685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] PATH_INFO: `/v3/users/a6aa8184f95b49798645a96239787c7e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:10.146843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] RBAC: Authorizing `identity:get_user(user_id=a6aa8184f95b49798645a96239787c7e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:10.148259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:10.149894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 577/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:04:10 2022] GET /identity/v3/users/a6aa8184f95b49798645a96239787c7e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:10.155570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:10.251594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2490-bbf6-4508-ab69-211d53c17292 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:10.283506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174013d-ce2d-4b91-b460-931e68935db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:10.284126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174013d-ce2d-4b91-b460-931e68935db0 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:10.284402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174013d-ce2d-4b91-b460-931e68935db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:10.284660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174013d-ce2d-4b91-b460-931e68935db0 None admin] PATH_INFO: `/v3/projects/b3aab705c3dd41658053c6c3307332c2` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:10.285792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174013d-ce2d-4b91-b460-931e68935db0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3aab705c3dd41658053c6c3307332c2)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:10.287221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174013d-ce2d-4b91-b460-931e68935db0 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:10.288821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 575/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:04:10 2022] GET /identity/v3/projects/b3aab705c3dd41658053c6c3307332c2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:10.294671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:10.391992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca65ed2-e28e-4109-9481-e82f2b5546b5 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:10.405204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:10.425966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ebb62-d632-45bf-b652-a2b2d3973fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:10.426657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ebb62-d632-45bf-b652-a2b2d3973fac None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:10.426932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ebb62-d632-45bf-b652-a2b2d3973fac None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:10.427199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ebb62-d632-45bf-b652-a2b2d3973fac None admin] PATH_INFO: `/v3/projects/b3aab705c3dd41658053c6c3307332c2/users/a6aa8184f95b49798645a96239787c7e/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:10.429091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ebb62-d632-45bf-b652-a2b2d3973fac None admin] RBAC: Authorizing `identity:create_grant(project_id=b3aab705c3dd41658053c6c3307332c2, user_id=a6aa8184f95b49798645a96239787c7e, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:10.430523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ebb62-d632-45bf-b652-a2b2d3973fac None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:10.443214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 578/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:04:10 2022] PUT /identity/v3/projects/b3aab705c3dd41658053c6c3307332c2/users/a6aa8184f95b49798645a96239787c7e/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:04:12.386773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ef4d-96f5-4958-a26f-e929a586c7c2 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:12.387299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ef4d-96f5-4958-a26f-e929a586c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:12.387299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ef4d-96f5-4958-a26f-e929a586c7c2 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:12.388567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 576/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:12.397202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc3559-309d-42e4-9ab1-bd8538403e8e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:12.397639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc3559-309d-42e4-9ab1-bd8538403e8e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:12.397826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc3559-309d-42e4-9ab1-bd8538403e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:12.416165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-00fc3559-309d-42e4-9ab1-bd8538403e8e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:12.417341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-00fc3559-309d-42e4-9ab1-bd8538403e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:12.481670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 579/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:12.504981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ef4d-96f5-4958-a26f-e929a586c7c2 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:12.566195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:12.604402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ef4d-96f5-4958-a26f-e929a586c7c2 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:12.637037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:12.637599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:12.637874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:12.638149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:12.648409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:04:12.653228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:04:12.654327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:04:12.655315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 577/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:04:12.660921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc3559-309d-42e4-9ab1-bd8538403e8e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:12.756469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc3559-309d-42e4-9ab1-bd8538403e8e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:12.758693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:12.791049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:12.791658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:12.791932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:12.792199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:12.792896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:12.793194 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:12.794575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:12.802513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 580/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:12.808268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:12.917956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330d8a1-1d43-4d3f-8d7f-2537809e9238 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:12.939813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:12.950542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:12.951179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:12.951461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:12.951734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] PATH_INFO: `/v3/users/a6aa8184f95b49798645a96239787c7e` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:12.952880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] RBAC: Authorizing `identity:get_user(user_id=a6aa8184f95b49798645a96239787c7e)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:12.954876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:12.956490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 578/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:04:12 2022] GET /identity/v3/users/a6aa8184f95b49798645a96239787c7e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:12.962325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:13.064609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a167dd-0c43-4489-96ca-db3f44143207 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:13.096227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:13.096827 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:13.097102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:13.097368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:13.129563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:13.162744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:13.164174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:13.257000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 581/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:04:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:04:13.262827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:13.358822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03053d0b-855c-4147-918c-b8f85734a2bb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:13.391133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e23b20-50c3-4731-880e-ab758f8e02cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:13.391900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e23b20-50c3-4731-880e-ab758f8e02cd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:13.392018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e23b20-50c3-4731-880e-ab758f8e02cd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:13.392290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e23b20-50c3-4731-880e-ab758f8e02cd None admin] PATH_INFO: `/v3/projects/b3aab705c3dd41658053c6c3307332c2` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:13.393434 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e23b20-50c3-4731-880e-ab758f8e02cd None admin] RBAC: Authorizing `identity:get_project(project_id=b3aab705c3dd41658053c6c3307332c2)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:13.394888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e23b20-50c3-4731-880e-ab758f8e02cd None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:13.396504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 579/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:04:13 2022] GET /identity/v3/projects/b3aab705c3dd41658053c6c3307332c2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:13.402512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:13.465310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:13.498636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5a630-7eb0-4fd0-a399-b04646698f64 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:13.531299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236cccf-6198-4e7d-9e4c-35f6b3d9414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:13.532416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236cccf-6198-4e7d-9e4c-35f6b3d9414c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:13.532690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236cccf-6198-4e7d-9e4c-35f6b3d9414c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:13.532955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236cccf-6198-4e7d-9e4c-35f6b3d9414c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:13.533714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236cccf-6198-4e7d-9e4c-35f6b3d9414c None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=b3aab705c3dd41658053c6c3307332c2, user.id=a6aa8184f95b49798645a96239787c7e) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:13.534015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236cccf-6198-4e7d-9e4c-35f6b3d9414c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:13.535454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236cccf-6198-4e7d-9e4c-35f6b3d9414c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:13.540916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 582/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:04:13 2022] GET /identity/v3/role_assignments?user.id=a6aa8184f95b49798645a96239787c7e&scope.project.id=b3aab705c3dd41658053c6c3307332c2&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:15.510503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b412-8ee4-4f69-806a-a468073f60a6 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:15.511064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b412-8ee4-4f69-806a-a468073f60a6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:15.511064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b412-8ee4-4f69-806a-a468073f60a6 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:15.512285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 580/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:15.517986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b03cbc-b8b4-47eb-aa37-1cd889aae906 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:15.518409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b03cbc-b8b4-47eb-aa37-1cd889aae906 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:15.518569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b03cbc-b8b4-47eb-aa37-1cd889aae906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:15.536272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-17b03cbc-b8b4-47eb-aa37-1cd889aae906 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:15.537699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-17b03cbc-b8b4-47eb-aa37-1cd889aae906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:15.610554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 583/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:15.632986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0b412-8ee4-4f69-806a-a468073f60a6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:15.692412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:15.733027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0b412-8ee4-4f69-806a-a468073f60a6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:15.766278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:15.766833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:15.767109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:15.767381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:15.831905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:15.833337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:15.888031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:15.928789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 581/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:04:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:04:15.935231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b03cbc-b8b4-47eb-aa37-1cd889aae906 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:15.991964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:16.031465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b03cbc-b8b4-47eb-aa37-1cd889aae906 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:16.064110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdb2d7-f28a-4843-b52f-0ec02fc303ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:16.064728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb2d7-f28a-4843-b52f-0ec02fc303ab None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:16.065028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb2d7-f28a-4843-b52f-0ec02fc303ab None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:16.065293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb2d7-f28a-4843-b52f-0ec02fc303ab None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:16.071673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdb2d7-f28a-4843-b52f-0ec02fc303ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:16.073101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdb2d7-f28a-4843-b52f-0ec02fc303ab None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cbfdb2d7-f28a-4843-b52f-0ec02fc303ab None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:04:16.084281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:04:16.085524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:04:16.086438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 584/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:04:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:04:16.091402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:16.186968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014e8e6-2b2d-4aa1-b048-4d0c495c1064 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:16.219386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebc33c-5f4d-4817-a3da-6e4646607bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:16.219986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebc33c-5f4d-4817-a3da-6e4646607bfb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:16.220263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebc33c-5f4d-4817-a3da-6e4646607bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:16.220533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebc33c-5f4d-4817-a3da-6e4646607bfb None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:16.221210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebc33c-5f4d-4817-a3da-6e4646607bfb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:16.221511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebc33c-5f4d-4817-a3da-6e4646607bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:16.222897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebc33c-5f4d-4817-a3da-6e4646607bfb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:16.229744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 582/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 28 22:04:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:18.203470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba63ed-332a-439b-9a7d-139c3fd51d9c None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:18.203971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba63ed-332a-439b-9a7d-139c3fd51d9c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:18.204055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba63ed-332a-439b-9a7d-139c3fd51d9c None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:18.205349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 585/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:18.210406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747db94-ce0c-4a9d-841b-8a5649e3b1b1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:18.210847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747db94-ce0c-4a9d-841b-8a5649e3b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:18.210985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747db94-ce0c-4a9d-841b-8a5649e3b1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:18.229191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-4747db94-ce0c-4a9d-841b-8a5649e3b1b1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:18.230405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4747db94-ce0c-4a9d-841b-8a5649e3b1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:18.247150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:18.295538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 583/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:18.318388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba63ed-332a-439b-9a7d-139c3fd51d9c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:18.416473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba63ed-332a-439b-9a7d-139c3fd51d9c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:18.434843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:18.448997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c0419-8a52-41c6-8931-fa4e8e8baa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:18.449598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0419-8a52-41c6-8931-fa4e8e8baa2c None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:18.449875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0419-8a52-41c6-8931-fa4e8e8baa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:18.450146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0419-8a52-41c6-8931-fa4e8e8baa2c None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:18.450874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c0419-8a52-41c6-8931-fa4e8e8baa2c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:18.452229 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c0419-8a52-41c6-8931-fa4e8e8baa2c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:18.468110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 586/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu Jul 28 22:04:18 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:04:20.476409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704fd2-2aea-4a15-965a-8d8669774d88 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:20.476924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704fd2-2aea-4a15-965a-8d8669774d88 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:20.476924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704fd2-2aea-4a15-965a-8d8669774d88 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:20.478216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 584/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:20.483346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeb83b-469f-4c55-a163-ac729369dd17 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:20.483722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeb83b-469f-4c55-a163-ac729369dd17 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:20.483903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeb83b-469f-4c55-a163-ac729369dd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:20.501497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-dedeb83b-469f-4c55-a163-ac729369dd17 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:20.502975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dedeb83b-469f-4c55-a163-ac729369dd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:20.567478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 587/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:20.590174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704fd2-2aea-4a15-965a-8d8669774d88 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:20.686161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704fd2-2aea-4a15-965a-8d8669774d88 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:20.718909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda74bf8-4c1a-49aa-82ca-45782dc6543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:20.719520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda74bf8-4c1a-49aa-82ca-45782dc6543d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:20.719796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda74bf8-4c1a-49aa-82ca-45782dc6543d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:20.720065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda74bf8-4c1a-49aa-82ca-45782dc6543d None admin] PATH_INFO: `/v3/domains/cc0564e103004c2f9964ec04099fdf01` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:20.730125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda74bf8-4c1a-49aa-82ca-45782dc6543d None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0564e103004c2f9964ec04099fdf01)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:20.731530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda74bf8-4c1a-49aa-82ca-45782dc6543d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:20.733076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 585/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jul 28 22:04:20 2022] GET /identity/v3/domains/cc0564e103004c2f9964ec04099fdf01 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:20.738925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedeb83b-469f-4c55-a163-ac729369dd17 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:20.836684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedeb83b-469f-4c55-a163-ac729369dd17 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:20.846802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:20.872820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6de8f1-306a-45c7-b9cd-71628e87bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:20.873436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de8f1-306a-45c7-b9cd-71628e87bc39 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:20.873758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de8f1-306a-45c7-b9cd-71628e87bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:20.874139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de8f1-306a-45c7-b9cd-71628e87bc39 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:20.875390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6de8f1-306a-45c7-b9cd-71628e87bc39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:20.877061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6de8f1-306a-45c7-b9cd-71628e87bc39 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:20.902693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 588/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:04:20 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:04:22.895170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4490e25-1cf1-4139-a64f-e7b47e8b1f6a None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:22.895731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4490e25-1cf1-4139-a64f-e7b47e8b1f6a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:22.895731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4490e25-1cf1-4139-a64f-e7b47e8b1f6a None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:22.897065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 586/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:22.902281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b725b-99ff-47ea-b127-2803a9a8caaf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:22.902703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b725b-99ff-47ea-b127-2803a9a8caaf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:22.902829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b725b-99ff-47ea-b127-2803a9a8caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:22.920504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-385b725b-99ff-47ea-b127-2803a9a8caaf None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:22.921675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-385b725b-99ff-47ea-b127-2803a9a8caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:22.986048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 589/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:23.009896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4490e25-1cf1-4139-a64f-e7b47e8b1f6a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:23.026576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:23.114569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4490e25-1cf1-4139-a64f-e7b47e8b1f6a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:23.147010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eedf02-c057-4ac7-89cf-99d37652b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:23.147596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eedf02-c057-4ac7-89cf-99d37652b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:23.147876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eedf02-c057-4ac7-89cf-99d37652b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:23.148150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eedf02-c057-4ac7-89cf-99d37652b4f3 None admin] PATH_INFO: `/v3/domains/cc0564e103004c2f9964ec04099fdf01` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:23.149298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eedf02-c057-4ac7-89cf-99d37652b4f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0564e103004c2f9964ec04099fdf01)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:23.150774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eedf02-c057-4ac7-89cf-99d37652b4f3 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:23.152355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 587/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jul 28 22:04:23 2022] GET /identity/v3/domains/cc0564e103004c2f9964ec04099fdf01 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:23.158581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b725b-99ff-47ea-b127-2803a9a8caaf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:23.244902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:23.254220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b725b-99ff-47ea-b127-2803a9a8caaf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:23.288123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46358691-62dc-4e77-ab3d-c85a920c90f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:23.288725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358691-62dc-4e77-ab3d-c85a920c90f7 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:23.289004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358691-62dc-4e77-ab3d-c85a920c90f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:23.289272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358691-62dc-4e77-ab3d-c85a920c90f7 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:23.289946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46358691-62dc-4e77-ab3d-c85a920c90f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:23.291429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46358691-62dc-4e77-ab3d-c85a920c90f7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:23.311128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 590/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:04:23 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:04:25.320316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b9b48-3fe8-408b-ae9c-45032e9a43d8 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:25.320857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b9b48-3fe8-408b-ae9c-45032e9a43d8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:25.320857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b9b48-3fe8-408b-ae9c-45032e9a43d8 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:25.322192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 588/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:25.327367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba798e4-7cd9-4452-b011-df4b0cac61fc None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:25.328318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba798e4-7cd9-4452-b011-df4b0cac61fc None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:25.328454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba798e4-7cd9-4452-b011-df4b0cac61fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:25.350206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8ba798e4-7cd9-4452-b011-df4b0cac61fc None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:25.351486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8ba798e4-7cd9-4452-b011-df4b0cac61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:25.416510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 591/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:25.440021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b9b48-3fe8-408b-ae9c-45032e9a43d8 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:25.519475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:25.538016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b9b48-3fe8-408b-ae9c-45032e9a43d8 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:25.570478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:25.571097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:25.571371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:25.571638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:25.581773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:04:25.586613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:04:25.587724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:04:25.588926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 589/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:04:25.593663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba798e4-7cd9-4452-b011-df4b0cac61fc None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:25.668386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:25.690660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba798e4-7cd9-4452-b011-df4b0cac61fc None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:25.723718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:25.724332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:25.724610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:25.724878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:25.725584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:25.725885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:25.727296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:25.735680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 592/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:25.741606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:25.841046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667e30-8f96-471f-bd52-49138688d144 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:25.873806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:25.874457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:25.874744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:25.875011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] PATH_INFO: `/v3/users/245fa925e2ee430da94742e34819a7cc` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:25.886346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:25.888919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] RBAC: Authorizing `identity:get_user(user_id=245fa925e2ee430da94742e34819a7cc)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:25.890660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:25.892312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 590/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:04:25 2022] GET /identity/v3/users/245fa925e2ee430da94742e34819a7cc => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:25.898162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:25.993787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896a3f-658b-4e77-8dae-29c7e4361ab8 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:26.025462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:26.026063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:26.026365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:26.026644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:26.037146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:26.094875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:26.096336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:26.190384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 593/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:04:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:04:26.196204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:26.293564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732034be-4900-4eb8-a96f-f72e2baf59f2 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:26.325916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419ce67-e2b7-493e-9694-4c9b09ec53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:26.326578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ce67-e2b7-493e-9694-4c9b09ec53b7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:26.326857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ce67-e2b7-493e-9694-4c9b09ec53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:26.327146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ce67-e2b7-493e-9694-4c9b09ec53b7 None admin] PATH_INFO: `/v3/projects/02eec636ed674af9930ed50874a7d436` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:26.328814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419ce67-e2b7-493e-9694-4c9b09ec53b7 None admin] RBAC: Authorizing `identity:get_project(project_id=02eec636ed674af9930ed50874a7d436)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:26.330254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419ce67-e2b7-493e-9694-4c9b09ec53b7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:26.331982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 591/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:04:26 2022] GET /identity/v3/projects/02eec636ed674af9930ed50874a7d436 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:26.337799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:26.377977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:26.433487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fdc92-81de-431f-90bc-074c5c9ca89d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:26.465981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15375dd2-435e-487f-a29f-409f65b0c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:26.466606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15375dd2-435e-487f-a29f-409f65b0c34b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:26.466884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15375dd2-435e-487f-a29f-409f65b0c34b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:26.467154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15375dd2-435e-487f-a29f-409f65b0c34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:26.467921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15375dd2-435e-487f-a29f-409f65b0c34b None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=02eec636ed674af9930ed50874a7d436, user.id=245fa925e2ee430da94742e34819a7cc) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:26.468273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15375dd2-435e-487f-a29f-409f65b0c34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:26.470190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15375dd2-435e-487f-a29f-409f65b0c34b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:26.475392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 594/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:04:26 2022] GET /identity/v3/role_assignments?user.id=245fa925e2ee430da94742e34819a7cc&scope.project.id=02eec636ed674af9930ed50874a7d436&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:28.417446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0d2c4-7b17-4c08-ab48-24bd12d0bb98 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:28.417971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0d2c4-7b17-4c08-ab48-24bd12d0bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:28.417971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0d2c4-7b17-4c08-ab48-24bd12d0bb98 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:28.419276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 592/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:28.425173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb3edb-5b81-49f5-b03e-db79b9ef02b9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:28.425591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb3edb-5b81-49f5-b03e-db79b9ef02b9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:28.425716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb3edb-5b81-49f5-b03e-db79b9ef02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:28.443996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cbfb3edb-5b81-49f5-b03e-db79b9ef02b9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:28.445178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cbfb3edb-5b81-49f5-b03e-db79b9ef02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:28.508891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 595/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:28.531321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0d2c4-7b17-4c08-ab48-24bd12d0bb98 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:28.595872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:28.629151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0d2c4-7b17-4c08-ab48-24bd12d0bb98 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:28.662520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:28.663145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:28.663425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:28.663699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:28.673602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:04:28.678457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:04:28.679620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:04:28.680715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 593/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:04:28.685372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb3edb-5b81-49f5-b03e-db79b9ef02b9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:28.717387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:28.780553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb3edb-5b81-49f5-b03e-db79b9ef02b9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:28.813140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:28.813735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:28.814009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:28.814297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:28.814990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:28.815285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:28.816637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:28.824295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 596/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:28.830600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:28.929380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609530-f77b-4b50-a257-bd083403f94b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:28.955750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:28.963619 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:28.964259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:28.964538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:28.964817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] PATH_INFO: `/v3/users/245fa925e2ee430da94742e34819a7cc` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:28.965968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] RBAC: Authorizing `identity:get_user(user_id=245fa925e2ee430da94742e34819a7cc)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:28.967429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:28.969113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 594/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:04:28 2022] GET /identity/v3/users/245fa925e2ee430da94742e34819a7cc => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:28.975002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:29.064710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:29.070475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ade4-4ce6-40d9-a69e-e0bf798c5a48 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:29.101965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a76e3c-2f97-433e-b898-67cce39fd535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:29.102617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76e3c-2f97-433e-b898-67cce39fd535 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:29.102897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76e3c-2f97-433e-b898-67cce39fd535 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:29.103162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76e3c-2f97-433e-b898-67cce39fd535 None admin] PATH_INFO: `/v3/projects/02eec636ed674af9930ed50874a7d436` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:29.104295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a76e3c-2f97-433e-b898-67cce39fd535 None admin] RBAC: Authorizing `identity:get_project(project_id=02eec636ed674af9930ed50874a7d436)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:29.105704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a76e3c-2f97-433e-b898-67cce39fd535 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:29.107364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 597/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:04:28 2022] GET /identity/v3/projects/02eec636ed674af9930ed50874a7d436 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:29.113216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:29.209842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158382c0-f8ea-47c4-9842-00322f4398aa None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:29.242176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e172-c7a1-4426-9f3a-746da73ff656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:29.242997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e172-c7a1-4426-9f3a-746da73ff656 None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:29.243281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e172-c7a1-4426-9f3a-746da73ff656 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:29.243554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e172-c7a1-4426-9f3a-746da73ff656 None admin] PATH_INFO: `/v3/projects/02eec636ed674af9930ed50874a7d436/users/245fa925e2ee430da94742e34819a7cc/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:29.245442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e172-c7a1-4426-9f3a-746da73ff656 None admin] RBAC: Authorizing `identity:create_grant(project_id=02eec636ed674af9930ed50874a7d436, user_id=245fa925e2ee430da94742e34819a7cc, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:29.246916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e172-c7a1-4426-9f3a-746da73ff656 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:29.259788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 595/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:04:29 2022] PUT /identity/v3/projects/02eec636ed674af9930ed50874a7d436/users/245fa925e2ee430da94742e34819a7cc/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:04:31.211028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7abc52-e730-49a5-b953-8f383eb8922d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:31.211513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7abc52-e730-49a5-b953-8f383eb8922d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:31.211618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7abc52-e730-49a5-b953-8f383eb8922d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:31.212918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 598/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:04:31.218503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8c180-ffb6-4d04-acfa-ccf541ee9e36 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:31.218927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8c180-ffb6-4d04-acfa-ccf541ee9e36 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:31.219057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8c180-ffb6-4d04-acfa-ccf541ee9e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:31.237905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3fe8c180-ffb6-4d04-acfa-ccf541ee9e36 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:04:31.239110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3fe8c180-ffb6-4d04-acfa-ccf541ee9e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:04:31.287348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:31.304517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 596/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:04:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:04:31.328024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7abc52-e730-49a5-b953-8f383eb8922d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:31.431729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7abc52-e730-49a5-b953-8f383eb8922d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:31.463776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:31.464401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:31.464683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:31.464954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:31.475148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:04:31.479998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:04:31.481058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:04:31.482118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 599/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:04:31.487784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8c180-ffb6-4d04-acfa-ccf541ee9e36 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:31.583230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8c180-ffb6-4d04-acfa-ccf541ee9e36 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:31.615643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:31.616241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:31.616519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:31.616789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:31.617493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:31.617792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:31.619171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:31.627812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 597/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:31.633435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:31.659281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:31.732521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa943f94-ed6b-406b-9f4c-8f12f663e0fd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:31.765432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:31.766056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:31.766365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:31.766639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] PATH_INFO: `/v3/users/245fa925e2ee430da94742e34819a7cc` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:31.767796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=245fa925e2ee430da94742e34819a7cc)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:31.769218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:31.770828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 600/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 28 22:04:31 2022] GET /identity/v3/users/245fa925e2ee430da94742e34819a7cc => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:31.776576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:31.825150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:31.873814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58d7d1-b063-4340-87f9-10f09c137e0e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:31.905293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:31.906441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:31.906716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:31.906981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:31.972094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:31.973529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:32.018607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:32.068378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 598/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:04:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:04:32.074197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:32.163777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:32.172938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce649a7-bd24-499a-8431-9558fb6af4e1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:32.205197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f9c2-d08a-4a16-86c5-7e83b9bc5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:32.205817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f9c2-d08a-4a16-86c5-7e83b9bc5426 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:32.206097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f9c2-d08a-4a16-86c5-7e83b9bc5426 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:32.206413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f9c2-d08a-4a16-86c5-7e83b9bc5426 None admin] PATH_INFO: `/v3/projects/02eec636ed674af9930ed50874a7d436` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:32.207552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f9c2-d08a-4a16-86c5-7e83b9bc5426 None admin] RBAC: Authorizing `identity:get_project(project_id=02eec636ed674af9930ed50874a7d436)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:32.208979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f9c2-d08a-4a16-86c5-7e83b9bc5426 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:32.210640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 601/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 28 22:04:32 2022] GET /identity/v3/projects/02eec636ed674af9930ed50874a7d436 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:32.216696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:04:32.311659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37282e80-a70b-4be1-b8e3-5ee2f769764d None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:04:32.344738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d7564-a793-478e-8e2c-e292c33354d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:04:32.345334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d7564-a793-478e-8e2c-e292c33354d0 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:04:32.345613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d7564-a793-478e-8e2c-e292c33354d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:04:32.345885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d7564-a793-478e-8e2c-e292c33354d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:04:32.346682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d7564-a793-478e-8e2c-e292c33354d0 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=02eec636ed674af9930ed50874a7d436, user.id=245fa925e2ee430da94742e34819a7cc) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:04:32.346989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d7564-a793-478e-8e2c-e292c33354d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:04:32.348397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d7564-a793-478e-8e2c-e292c33354d0 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:04:32.353894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 599/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:04:32 2022] GET /identity/v3/role_assignments?user.id=245fa925e2ee430da94742e34819a7cc&scope.project.id=02eec636ed674af9930ed50874a7d436&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:04:42.200610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=20 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:04:42.351409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=94 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:26.924214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d6eb8-3692-4b84-9633-5ad1ad72a975 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:26.924916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d6eb8-3692-4b84-9633-5ad1ad72a975 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:26.924916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d6eb8-3692-4b84-9633-5ad1ad72a975 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:26.926854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 602/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:05:26.935928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79463f9-a98d-450d-b9cf-cac99623a01f None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:26.935928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79463f9-a98d-450d-b9cf-cac99623a01f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:26.935928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79463f9-a98d-450d-b9cf-cac99623a01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:26.953564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f79463f9-a98d-450d-b9cf-cac99623a01f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:26.954923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f79463f9-a98d-450d-b9cf-cac99623a01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:27.058331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 600/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:05:27.077481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d6eb8-3692-4b84-9633-5ad1ad72a975 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:27.217539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d6eb8-3692-4b84-9633-5ad1ad72a975 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:27.274156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:27.274844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:27.275135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:27.275378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:27.287190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:27.288635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:27.305252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:27.306377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:27.307704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:27.307704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:27.307704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:27.307704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:27.307704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 603/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:27.314054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79463f9-a98d-450d-b9cf-cac99623a01f None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:27.440585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79463f9-a98d-450d-b9cf-cac99623a01f None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:27.480859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:27.489858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b85ad-a73e-4386-aabd-dd2d7ff07c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:27.490756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b85ad-a73e-4386-aabd-dd2d7ff07c04 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:27.491360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b85ad-a73e-4386-aabd-dd2d7ff07c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:27.491793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b85ad-a73e-4386-aabd-dd2d7ff07c04 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:27.492853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b85ad-a73e-4386-aabd-dd2d7ff07c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:27.493390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b85ad-a73e-4386-aabd-dd2d7ff07c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:27.495409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b85ad-a73e-4386-aabd-dd2d7ff07c04 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:27.515405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 601/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:27.522392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:27.593553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:27.647883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d3223-b83b-4350-ac37-3c9c0a8f5afe None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:27.701067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b18b5-3a8b-44e0-8d34-e0181a96159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:27.702168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b18b5-3a8b-44e0-8d34-e0181a96159c None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:27.702696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b18b5-3a8b-44e0-8d34-e0181a96159c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:27.703135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b18b5-3a8b-44e0-8d34-e0181a96159c None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:27.703965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b18b5-3a8b-44e0-8d34-e0181a96159c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:27.705638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b18b5-3a8b-44e0-8d34-e0181a96159c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:27.733024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 604/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 28 22:05:27 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:05:30.022373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7387e-4505-426a-b754-498a0283b776 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:30.022918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7387e-4505-426a-b754-498a0283b776 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:30.022918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7387e-4505-426a-b754-498a0283b776 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:30.024601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 602/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:30.029936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428517-ed3c-4c0b-9464-1ce63e1937f2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:30.030399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428517-ed3c-4c0b-9464-1ce63e1937f2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:30.030562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428517-ed3c-4c0b-9464-1ce63e1937f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:30.050630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e1428517-ed3c-4c0b-9464-1ce63e1937f2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:30.051915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e1428517-ed3c-4c0b-9464-1ce63e1937f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:30.138297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 605/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:05:30.159235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7387e-4505-426a-b754-498a0283b776 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:30.283553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7387e-4505-426a-b754-498a0283b776 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:30.323506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:30.324087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:30.324361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:30.324628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:30.336880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:05:30.341873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:30.342885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:30.343748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 603/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:05:30.349044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1428517-ed3c-4c0b-9464-1ce63e1937f2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:30.399260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:30.470641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1428517-ed3c-4c0b-9464-1ce63e1937f2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:30.510679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:30.511302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:30.511579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:30.511847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:30.512556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:30.512854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:30.514938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:30.523813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 606/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:05:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:30.529605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:30.596976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:30.653899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad23be9-9321-4333-9e8c-febe6b2b443b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:30.692930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:30.693581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:30.694459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:30.694815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:30.706161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:30.707641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:30.722536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:30.723588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:30.726308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:30.726308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:30.726308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:30.726308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:30.726308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 604/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:30.731234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:30.854624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:30.858455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816a020-4446-45d4-9ff7-330bc841145d None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:30.897838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:30.898478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:30.898757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:30.899026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:30.899707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:30.900009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:30.901461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:30.914150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 607/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:05:30.920408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:31.030544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c366fa-56dc-41a2-8a5d-db8a9be0357c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:31.032340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:31.068517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:31.069175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:31.069717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:31.069717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:31.077875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:31.079517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:05:31.091328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:31.092989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:31.099005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 605/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:31.101354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:31.225377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9270-cf93-435c-aeec-faf0cf17ce28 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:31.264073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:31.264662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:31.264942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:31.265209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:31.265991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:31.266326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:31.267896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:31.288439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 608/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 28 22:05:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:31.294356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:31.409914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db258-0b3f-439f-b8bb-832c2892de13 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:31.445166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:31.445792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:31.446076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:31.446374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:31.479318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:31.530084 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:31.531684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:31.640184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 606/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:05:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:05:31.645924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:31.665350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:31.750055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a754ed-f57c-4e7f-b51b-66bb07342d5b None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:31.785682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:31.786352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:31.786635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:31.786908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:31.799926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:31.801382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:31.816942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:31.817946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:31.818912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:31.818912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:31.818912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:31.818912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:31.818912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 609/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:05:31.823898 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:31.893187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:31.938932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a25b-62ce-4fa1-b679-19beaccc740c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:31.977236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:31.978026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:31.978499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:31.978824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:31.979578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:31.980121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:31.981814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:31.999727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 607/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:32.001559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:32.080023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:32.116995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da191ed-2e7d-454c-813c-1ed10e7469cb None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:32.152116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:32.152732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:32.153014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:32.153285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:32.160776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:32.162214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:05:32.177707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:32.178732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:32.179653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:32.183793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 610/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:05:32.184698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:32.293993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9a76-e175-432a-bd4a-1b252e7c7056 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:32.322590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:32.338258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec6edb-4523-4e56-a09b-19f7fae91f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:32.339261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec6edb-4523-4e56-a09b-19f7fae91f29 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:32.339746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec6edb-4523-4e56-a09b-19f7fae91f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:32.340228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec6edb-4523-4e56-a09b-19f7fae91f29 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:32.341195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec6edb-4523-4e56-a09b-19f7fae91f29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:32.342144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec6edb-4523-4e56-a09b-19f7fae91f29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:32.343660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec6edb-4523-4e56-a09b-19f7fae91f29 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:32.361954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 608/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:32.367924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:32.489924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b047900-3b61-4259-926f-67b3b6e102d2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:32.519636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:32.526423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e1ec2-0251-47c9-8b0c-ac39702ab05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:32.527120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1ec2-0251-47c9-8b0c-ac39702ab05c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:32.527495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1ec2-0251-47c9-8b0c-ac39702ab05c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:32.527869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1ec2-0251-47c9-8b0c-ac39702ab05c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:32.528790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1ec2-0251-47c9-8b0c-ac39702ab05c None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=3cd150c9bbd648feb1a2688397c3bc67) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:32.529779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1ec2-0251-47c9-8b0c-ac39702ab05c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:32.531320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1ec2-0251-47c9-8b0c-ac39702ab05c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:32.537565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 611/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:05:32 2022] GET /identity/v3/role_assignments?user.id=3cd150c9bbd648feb1a2688397c3bc67&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:34.520792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64484f99-8175-4dde-9ba5-9dd394750362 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:34.521435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64484f99-8175-4dde-9ba5-9dd394750362 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:34.521435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64484f99-8175-4dde-9ba5-9dd394750362 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:34.522991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 609/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:34.528585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2bb3d-388b-4d11-ba7c-44acb6a2c2f5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:34.529036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2bb3d-388b-4d11-ba7c-44acb6a2c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:34.529201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2bb3d-388b-4d11-ba7c-44acb6a2c2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:34.548033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-67c2bb3d-388b-4d11-ba7c-44acb6a2c2f5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:34.549232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-67c2bb3d-388b-4d11-ba7c-44acb6a2c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:34.618381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 612/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:05:34.641426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64484f99-8175-4dde-9ba5-9dd394750362 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:34.752524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64484f99-8175-4dde-9ba5-9dd394750362 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:34.789298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:34.789863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:34.790175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:34.790471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:34.802117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:05:34.807150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:34.808401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:34.809696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 610/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:05:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:34.814960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2bb3d-388b-4d11-ba7c-44acb6a2c2f5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:34.923483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2bb3d-388b-4d11-ba7c-44acb6a2c2f5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:34.949691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:34.962698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:34.963323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:34.963604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:34.963918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:34.964631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] RBAC: Adding query filter params (name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:34.964932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:34.966382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:34.974723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 613/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:05:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:34.981005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:35.032840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:35.096673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae195-5191-483d-ad20-347d2829af99 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:35.129935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:35.130622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:35.130896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:35.131168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:35.144009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:35.145478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:35.161308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:35.162728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:35.164083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:35.164083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:35.164083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:35.164083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:35.166123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 611/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:35.173618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:35.286302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ac666-8eb3-4825-9369-3e7c2debf871 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:35.322305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:35.322919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:35.323198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:35.323471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:35.324157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:35.324462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:35.325823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:35.337998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 614/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:05:35.344037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:35.451022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:35.458014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf7f3-566e-4c55-b6fa-feb024af47eb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:35.495024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:35.495667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:35.495950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:35.496239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:35.505418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:35.507122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:05:35.519745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:35.521414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:35.522635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 612/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:05:35.527044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:35.576942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:35.639511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc3233-4fe5-4ca6-a1b9-29c3066fd8a1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:35.678273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:35.679496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:35.679769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:35.680105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:35.680979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:35.681385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:35.683069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:35.703212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 615/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 28 22:05:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:35.708962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:35.827099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da8420-30f2-40e2-b90b-bcbeec42d57c None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:35.865103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:35.865854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:35.866179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:35.866530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:35.878978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:35.880526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:35.896042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:35.897281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:35.898251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:35.898251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:35.898251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:35.898251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:35.898251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 613/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:35.903039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:36.028181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b6512-720c-4b6e-ac09-47b2ef35bc50 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:36.031281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:36.066777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:36.067465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:36.067806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:36.068105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:36.068860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:36.069223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:36.070846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:36.083715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 616/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:36.089557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:36.100425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:36.210108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb4903-1d50-4b7c-bd70-9b3e857d31ca None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:36.243340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:36.244016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:36.244303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:36.244557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:36.253901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:36.255900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:05:36.273058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:36.274206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:36.275438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 614/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:36.281939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:36.392317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4e99a-e57d-4387-89ce-ac7da0f25e24 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:36.429595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe743b1-a6fd-4bde-ba4e-30e696450328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:36.430333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe743b1-a6fd-4bde-ba4e-30e696450328 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:36.430616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe743b1-a6fd-4bde-ba4e-30e696450328 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:36.430888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe743b1-a6fd-4bde-ba4e-30e696450328 None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:36.431719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe743b1-a6fd-4bde-ba4e-30e696450328 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:36.432089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe743b1-a6fd-4bde-ba4e-30e696450328 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:36.433553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe743b1-a6fd-4bde-ba4e-30e696450328 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:36.447049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 617/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:36.454395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:36.531179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:36.573544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f692c5-dc0d-4f83-a251-94482bc35831 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:36.609306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a73058-25ba-41ac-8540-2090d879c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:36.610280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73058-25ba-41ac-8540-2090d879c42c None admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:36.610750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73058-25ba-41ac-8540-2090d879c42c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:36.611024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73058-25ba-41ac-8540-2090d879c42c None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/3cd150c9bbd648feb1a2688397c3bc67/roles/d897affd236f4dcc9e85a147bfe9d820` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:36.631282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a73058-25ba-41ac-8540-2090d879c42c None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=3cd150c9bbd648feb1a2688397c3bc67, role_id=d897affd236f4dcc9e85a147bfe9d820)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:36.632741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a73058-25ba-41ac-8540-2090d879c42c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:36.646415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 615/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:05:36 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/3cd150c9bbd648feb1a2688397c3bc67/roles/d897affd236f4dcc9e85a147bfe9d820 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:05:38.767993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f870e-8f0b-4ca9-bf8c-3ead62b75e8f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:38.768572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f870e-8f0b-4ca9-bf8c-3ead62b75e8f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:38.768572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f870e-8f0b-4ca9-bf8c-3ead62b75e8f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:38.772842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 618/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:38.776849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a8dd-bc09-4c70-a1a9-94ed0149f613 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:38.777250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a8dd-bc09-4c70-a1a9-94ed0149f613 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:38.777388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a8dd-bc09-4c70-a1a9-94ed0149f613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:38.795686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9a08a8dd-bc09-4c70-a1a9-94ed0149f613 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:38.796935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9a08a8dd-bc09-4c70-a1a9-94ed0149f613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:38.892244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 616/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:05:38.928685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f870e-8f0b-4ca9-bf8c-3ead62b75e8f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:38.963893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:39.046984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f870e-8f0b-4ca9-bf8c-3ead62b75e8f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:39.085475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:39.086360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:39.086643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:39.087030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:39.100942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:05:39.106280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:39.108025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:39.108929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 619/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 28 22:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:39.114163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08a8dd-bc09-4c70-a1a9-94ed0149f613 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:39.165586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:39.226180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08a8dd-bc09-4c70-a1a9-94ed0149f613 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:39.265581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:39.266343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:39.266710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:39.266988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:39.267701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:39.268052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:39.269724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:39.279151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 617/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 28 22:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:39.285443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:39.382644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:39.400678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c143f-3404-44a2-9417-b685ffcd75dd None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:39.437388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:39.438030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:39.438408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:39.438681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:39.449801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:39.452027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:39.467078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:39.468033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:39.468939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:39.468939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:39.468939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:39.468939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:39.468939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 620/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:39.474182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:39.589665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4d021-61f7-425e-8553-875e7becb4d8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:39.599498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:39.633965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:39.634668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:39.635056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:39.635406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:39.636111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:39.636456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:39.638583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:39.656887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 618/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:39.662664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:39.773125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7b7b0-8577-4617-a6a4-aa493fcedb72 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:39.811792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:39.812494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:39.812780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:39.813060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:39.816724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:39.823748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:39.825590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:05:39.840020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:39.841336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:39.842337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 621/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:39.847740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:39.962612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03bc6c-d680-48ba-b7d1-2aa63f0bb0cd None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:40.005063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:40.006793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:40.007056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:40.007413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:40.008856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:40.009430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:40.011322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:40.032328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 619/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 28 22:05:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:40.038209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:40.159012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0572-9119-4a4f-be1b-40e3c760374c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:40.197088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:40.197787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:40.198098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:40.198409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:40.270656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:40.279173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:40.280794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:40.384830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 622/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:05:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:05:40.391655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:40.420516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:40.505704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef7a2-7f99-4142-8932-f70742186f13 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:40.542908 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:40.543478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:40.543762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:40.544022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:40.555364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:40.556828 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:40.572217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:40.573432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:40.574626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:40.574626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:40.574626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:40.574626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:40.574626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 620/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:40.579328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:40.681642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:40.688955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6afe0-8907-4bed-95e1-f7db7e59cd44 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:40.730161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:40.731141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:40.731448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:40.732412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:40.733327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:40.733750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:40.735758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:40.752905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 623/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:40.758677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:40.868039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:40.901310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d579c5-d4ed-4e76-bb14-5b586aea1bef None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:40.937325 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:40.937976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:40.938280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:40.938608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:40.945861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:40.947341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:05:40.958646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:40.959715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:40.960809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:40.964551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 621/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:40.965885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:41.082411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c0f8-37b7-4216-9bf8-8e78a9773a44 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:41.123254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad16def-47e8-414a-9f37-ac7ddeccd94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:41.124017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16def-47e8-414a-9f37-ac7ddeccd94e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:41.124474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16def-47e8-414a-9f37-ac7ddeccd94e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:41.124936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16def-47e8-414a-9f37-ac7ddeccd94e None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:41.126451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad16def-47e8-414a-9f37-ac7ddeccd94e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:41.126964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad16def-47e8-414a-9f37-ac7ddeccd94e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:41.129365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad16def-47e8-414a-9f37-ac7ddeccd94e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:41.146131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 624/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:41.152132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:41.280001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562231-670b-4500-97ba-17ff601d7460 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:41.328277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b364e-9c58-4d1a-b0f8-b3b8c425b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:41.328896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b364e-9c58-4d1a-b0f8-b3b8c425b86a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:41.329175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b364e-9c58-4d1a-b0f8-b3b8c425b86a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:41.329514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b364e-9c58-4d1a-b0f8-b3b8c425b86a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:41.330377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b364e-9c58-4d1a-b0f8-b3b8c425b86a None admin] RBAC: Adding query filter params (role.id=d897affd236f4dcc9e85a147bfe9d820, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=3cd150c9bbd648feb1a2688397c3bc67) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:41.330805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b364e-9c58-4d1a-b0f8-b3b8c425b86a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:41.332267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b364e-9c58-4d1a-b0f8-b3b8c425b86a None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:41.338376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 622/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:05:41 2022] GET /identity/v3/role_assignments?user.id=3cd150c9bbd648feb1a2688397c3bc67&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=d897affd236f4dcc9e85a147bfe9d820 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:43.694956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c683e-4424-4b0d-9eab-e2dc1562a0ba None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:43.694956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c683e-4424-4b0d-9eab-e2dc1562a0ba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:43.694956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c683e-4424-4b0d-9eab-e2dc1562a0ba None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:43.694956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 625/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:43.696153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49fbe5-8e98-4599-9bc1-87cd6dbd8ecc None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:43.696153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49fbe5-8e98-4599-9bc1-87cd6dbd8ecc None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:43.696691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49fbe5-8e98-4599-9bc1-87cd6dbd8ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:43.704081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:43.716336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ab49fbe5-8e98-4599-9bc1-87cd6dbd8ecc None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:43.717549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ab49fbe5-8e98-4599-9bc1-87cd6dbd8ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:43.803635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 623/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 22:05:43.831760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c683e-4424-4b0d-9eab-e2dc1562a0ba None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:43.855280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:43.977565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c683e-4424-4b0d-9eab-e2dc1562a0ba None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:44.017065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:44.018099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:44.018416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:44.018684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:44.032869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:05:44.038107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:44.039421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:44.040592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 626/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:44.045976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49fbe5-8e98-4599-9bc1-87cd6dbd8ecc None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:44.167417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49fbe5-8e98-4599-9bc1-87cd6dbd8ecc None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:44.203465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:44.210736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:44.211329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:44.211627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:44.211943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:44.212677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:44.212977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:44.214367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:44.229698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 624/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:44.232343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:44.319838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:44.345658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f26a35-f24a-4f4f-a4e7-626570decdb4 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:44.383645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:44.384485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:44.384799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:44.385117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:44.397793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:44.399300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:44.416542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:44.417794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:44.419147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:44.419147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:44.419147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:44.419147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:44.419147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 627/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:44.424441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:44.549745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5ef3-8a55-4a42-a121-9ada70a2f60e None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:44.588219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:44.588849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:44.589129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:44.589484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:44.590124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:44.590436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:44.591845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:44.606107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 625/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:44.611742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:44.729118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ecc8-2560-4cec-8b8e-5235ed21b18e None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:44.758597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:44.767445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:44.768089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:44.768368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:44.768652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:44.776556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:44.777992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:05:44.790489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:44.791721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:44.792912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:44.797029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 628/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:44.798341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:44.868961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:44.922846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac575fa-965f-4375-b705-23c70a20add8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:44.964288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:44.964950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:44.965235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:44.965511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:44.966478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:44.966794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:44.968324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:44.986549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 626/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 28 22:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:05:44.992544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:45.104198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dcfa4-1d8e-4b4a-b769-53b36b42422a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:45.142955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:45.143687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:45.144008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:45.144288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:45.209488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:45.224354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:45.225879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:45.339985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 629/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:05:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:05:45.346448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:45.469868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0f2e-afb0-45f3-a18d-49923ff965ef None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:45.485251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:45.511956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:45.512609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:45.513448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:45.513725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:45.525211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:45.526798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:45.543677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:45.544912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:45.546040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:45.546040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:45.546040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:45.546040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:45.546040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 627/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:45.551637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:45.657640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:45.671778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddbb49-0d37-4827-a832-195ddbf38985 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:45.711740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:45.712390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:45.712674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:45.712942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:45.713627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:45.713929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:45.715332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:45.727412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 630/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:45.733439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:45.850567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c88f78-47bf-47ef-a7cf-33be9f7879eb None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:45.896542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:45.897210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:45.897497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:45.897779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:45.906835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:45.908226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:05:45.921347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:45.922465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:45.923719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 628/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:45.928280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:46.035043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7b94c-65a5-49da-a80a-8a7a60c76fa1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:46.070912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a174662-ad0a-4e6d-901b-8c1bb68c7f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:46.071555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174662-ad0a-4e6d-901b-8c1bb68c7f3a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:46.071855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174662-ad0a-4e6d-901b-8c1bb68c7f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:46.072109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174662-ad0a-4e6d-901b-8c1bb68c7f3a None admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:46.072849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a174662-ad0a-4e6d-901b-8c1bb68c7f3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:46.073157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a174662-ad0a-4e6d-901b-8c1bb68c7f3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:46.074619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a174662-ad0a-4e6d-901b-8c1bb68c7f3a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:46.087206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 631/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:05:46.094167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:46.122961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:46.203071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b4701-f300-4feb-86bf-fc97f3d12c3f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:46.243706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf54ac-d84a-4a22-b81d-c411cb0c410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:46.244238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf54ac-d84a-4a22-b81d-c411cb0c410c None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:46.244518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf54ac-d84a-4a22-b81d-c411cb0c410c None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:46.244790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf54ac-d84a-4a22-b81d-c411cb0c410c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:46.245570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf54ac-d84a-4a22-b81d-c411cb0c410c None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=3cd150c9bbd648feb1a2688397c3bc67) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:46.245909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf54ac-d84a-4a22-b81d-c411cb0c410c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:46.247353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf54ac-d84a-4a22-b81d-c411cb0c410c None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:46.269053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 629/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:05:46 2022] GET /identity/v3/role_assignments?user.id=3cd150c9bbd648feb1a2688397c3bc67&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:48.251538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053029-1b9c-48be-91c4-6219b69ab07e None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:48.252057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053029-1b9c-48be-91c4-6219b69ab07e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:48.252057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053029-1b9c-48be-91c4-6219b69ab07e None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:48.253410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 632/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:48.258392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d5eec-a291-4d36-ae82-797896207c8e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:48.258779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d5eec-a291-4d36-ae82-797896207c8e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:48.258947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d5eec-a291-4d36-ae82-797896207c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:48.276662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-739d5eec-a291-4d36-ae82-797896207c8e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:48.277846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-739d5eec-a291-4d36-ae82-797896207c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:48.345693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 630/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:05:48.367317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053029-1b9c-48be-91c4-6219b69ab07e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:48.378664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:48.465709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053029-1b9c-48be-91c4-6219b69ab07e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:48.497890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:48.498533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:48.498813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:48.499082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:48.509030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:05:48.514501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:48.515576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:48.516546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 633/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:48.521431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d5eec-a291-4d36-ae82-797896207c8e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:48.539001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:48.615740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d5eec-a291-4d36-ae82-797896207c8e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:48.649277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:48.649886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:48.650166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:48.650465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:48.651172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:48.651476 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:48.652834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:48.660663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 631/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:48.666142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:48.730616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:48.765019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8ed5-4c1c-4982-809d-25e799123b3c None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:48.797656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:48.798299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:48.798578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:48.798871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:48.812379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:48.814311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:48.833202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:48.834171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:48.835319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:48.835319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:48.835319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:48.835319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:48.835319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 634/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:48.840910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:48.927457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:48.947084 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6a7af-217f-4cb6-9f9c-ef084c2be973 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:48.978948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:48.979554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:48.979832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:48.980103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:48.980829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:48.981085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:48.983011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:48.994198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 632/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:49.000711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:49.096047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bbbf3-6b68-446b-a2a6-72fed00b648a None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:49.115177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:49.129029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:49.129662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:49.129937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:49.130207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:49.138366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:49.139801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:05:49.150723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:49.151808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:49.152763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 635/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:49.158127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:49.254248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83391198-cd84-4a4c-b557-b9c566e7b408 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:49.286857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:49.287483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:49.287767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:49.288047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:49.288837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:49.289147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:49.290595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:49.302008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:49.312015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 633/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 28 22:05:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:49.317892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:49.416740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b25a31-86d9-40ec-9ab8-ad818a67ba53 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:49.449483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:49.450132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:49.450440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:49.450713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:49.460826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:49.462268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:49.476032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:49.477176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:49.478316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:49.478316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:49.478316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:49.478316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:49.478316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 636/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:49.483663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:49.582170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f621be-f5ee-4b8c-b91c-c536dcc0360b None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:49.615300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:49.615906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:49.616187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:49.616457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:49.617138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:49.617440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:49.618839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:49.630624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 634/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:49.636028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:49.665799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:49.732860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba3c28-091a-40a7-8b28-64256e5770c6 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:49.765585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:49.766205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:49.766520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:49.766788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:49.773265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:49.774742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:05:49.786275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:49.787331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:49.788565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 637/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:49.792962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:49.854533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:49.894977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b173c-7f83-4e26-a064-16c001ef1353 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:49.927544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61050c-7042-4f30-99ba-698849324ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:49.928143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61050c-7042-4f30-99ba-698849324ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:49.928418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61050c-7042-4f30-99ba-698849324ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:49.928684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61050c-7042-4f30-99ba-698849324ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:49.929417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61050c-7042-4f30-99ba-698849324ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:49.929716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61050c-7042-4f30-99ba-698849324ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:49.931154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61050c-7042-4f30-99ba-698849324ed9 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:49.942616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 635/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:49.948516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:50.035552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:50.045046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6cc1-c6e2-403f-bd30-57cb898a85c7 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:50.077616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae7e5b-5354-437e-a002-36d619a9e2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:50.078301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae7e5b-5354-437e-a002-36d619a9e2c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:50.078584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae7e5b-5354-437e-a002-36d619a9e2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:50.078855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae7e5b-5354-437e-a002-36d619a9e2c6 None admin] PATH_INFO: `/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/3cd150c9bbd648feb1a2688397c3bc67/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:50.080815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae7e5b-5354-437e-a002-36d619a9e2c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=351b3a08fcec462b94afa05f64f16ef6, user_id=3cd150c9bbd648feb1a2688397c3bc67, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:50.082268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae7e5b-5354-437e-a002-36d619a9e2c6 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:50.096529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 638/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 28 22:05:49 2022] PUT /identity/v3/projects/351b3a08fcec462b94afa05f64f16ef6/users/3cd150c9bbd648feb1a2688397c3bc67/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:05:52.053809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19671-c21b-4262-a71f-c1f30f42c8fe None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:52.054369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19671-c21b-4262-a71f-c1f30f42c8fe None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:52.054824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19671-c21b-4262-a71f-c1f30f42c8fe None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:52.056169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 636/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:52.061742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a9e1-0c3c-4fc3-aaf9-da41afb8a6b4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:52.062185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a9e1-0c3c-4fc3-aaf9-da41afb8a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:52.062302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a9e1-0c3c-4fc3-aaf9-da41afb8a6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:52.080718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8040a9e1-0c3c-4fc3-aaf9-da41afb8a6b4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:52.081932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8040a9e1-0c3c-4fc3-aaf9-da41afb8a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:52.148273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 639/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:05:52.171033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19671-c21b-4262-a71f-c1f30f42c8fe None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:52.270689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19671-c21b-4262-a71f-c1f30f42c8fe None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:52.287356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:52.303999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:52.304573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:52.304853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:52.305125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:52.315701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 22:05:52.320593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:52.321692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:52.322773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 637/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 28 22:05:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:52.328420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a9e1-0c3c-4fc3-aaf9-da41afb8a6b4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:52.405857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:52.424623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a9e1-0c3c-4fc3-aaf9-da41afb8a6b4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:52.458378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:52.458988 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:52.459267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:52.459538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:52.460239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:52.460544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:52.461899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:52.470275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 640/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 28 22:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:52.475924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:52.570368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6bd4c-f44d-4bda-ba8e-5e0970a5641a None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:52.603013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:52.603624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:52.603901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:52.604169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:52.613746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:52.615199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:52.629541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:52.630599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:52.631873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:52.631873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:52.631873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:52.631873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:52.631873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 638/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:52.636059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:52.731688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157273f1-ddf8-430b-9c4e-d89acc1f75b2 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:52.763394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:52.763984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:52.764259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:52.764525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:52.765193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:52.765489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:52.766852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:52.777961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 641/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:52.783987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:52.817848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:52.897597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e126-724b-4b1f-b1bf-06eb13ecbac7 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:52.929412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:52.930043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:52.930349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:52.930625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:52.938348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:52.939784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 22:05:52.951239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:52.952317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:52.953398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 639/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:05:52.958337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:52.962015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:53.053673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0fe14-4d66-402c-8def-7a94e8916cba None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:53.086315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:53.086915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:53.087190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:53.087454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:53.088222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:53.088519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:53.089915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:53.106224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 642/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 28 22:05:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:53.111846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:53.200633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:53.210136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6af5d4-6044-4426-bcbe-110dbb9f75ca None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:53.242784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:53.243396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:53.243679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:53.243950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:53.308458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:53.310474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:53.398904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:53.409025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 640/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 28 22:05:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 22:05:53.414841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:53.474484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:53.512294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214238-8dd3-48e1-93ba-75efc668c8ef None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:53.545514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:53.546131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:53.546435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:53.546708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:53.556303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:53.557716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 22:05:53.571785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:53.572867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:53.573828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 22:05:53.573828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 22:05:53.573828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 22:05:53.573828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:53.573828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 643/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:53.578537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:53.673200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07744c-80f7-4972-ba4f-564c2007ebc8 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:53.704817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:53.705413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:53.705690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:53.705960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:53.706662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:53.706961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:53.708305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:53.719479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 641/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 28 22:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:53.725099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:53.824556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ac4b6-1e5f-4e7f-b0e8-d614d9fd4aa1 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:53.837814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:53.858726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:53.859351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:53.859629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:53.859897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:53.866281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:53.867716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 22:05:53.879809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:53.880846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: ERROR keystone.server.flask.application Jul 28 22:05:53.881957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 644/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 28 22:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:53.887020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:53.935325 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:53.983477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c786-a88e-4fc0-91d8-3c519502790f None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:54.018481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be1e03-3f3c-4dbd-bb33-d3f24963a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:54.019081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be1e03-3f3c-4dbd-bb33-d3f24963a20b None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:54.019484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be1e03-3f3c-4dbd-bb33-d3f24963a20b None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:54.019987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be1e03-3f3c-4dbd-bb33-d3f24963a20b None admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:54.021140 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be1e03-3f3c-4dbd-bb33-d3f24963a20b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:54.021447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be1e03-3f3c-4dbd-bb33-d3f24963a20b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:54.023329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be1e03-3f3c-4dbd-bb33-d3f24963a20b None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:54.038846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 642/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 28 22:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:05:54.045087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:54.142343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de8b0a-9877-4afb-8449-f5eeed3262ed None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:54.174515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04538412-dc6d-4f83-8f68-c3148ee2a509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:54.175115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04538412-dc6d-4f83-8f68-c3148ee2a509 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:54.175393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04538412-dc6d-4f83-8f68-c3148ee2a509 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:54.175663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04538412-dc6d-4f83-8f68-c3148ee2a509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:54.176442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04538412-dc6d-4f83-8f68-c3148ee2a509 None admin] RBAC: Adding query filter params (role.id=5060abf6b18b41ad8d29655dc41e0007, scope.project.id=351b3a08fcec462b94afa05f64f16ef6, user.id=3cd150c9bbd648feb1a2688397c3bc67) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:54.176745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04538412-dc6d-4f83-8f68-c3148ee2a509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:54.178177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04538412-dc6d-4f83-8f68-c3148ee2a509 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:54.183733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 645/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 28 22:05:54 2022] GET /identity/v3/role_assignments?user.id=3cd150c9bbd648feb1a2688397c3bc67&scope.project.id=351b3a08fcec462b94afa05f64f16ef6&role.id=5060abf6b18b41ad8d29655dc41e0007 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:56.165369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a67dea-c85e-448e-a26f-d00cb4b91ff7 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:56.165841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a67dea-c85e-448e-a26f-d00cb4b91ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:56.165942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a67dea-c85e-448e-a26f-d00cb4b91ff7 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:56.167284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 643/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:56.172702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14a7af-21a5-4bd0-9c02-c095bd6aedc0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:56.173117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14a7af-21a5-4bd0-9c02-c095bd6aedc0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:56.173232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14a7af-21a5-4bd0-9c02-c095bd6aedc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:56.191426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8f14a7af-21a5-4bd0-9c02-c095bd6aedc0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:56.192603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8f14a7af-21a5-4bd0-9c02-c095bd6aedc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:56.220474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:56.257327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 646/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:05:56.279936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a67dea-c85e-448e-a26f-d00cb4b91ff7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:56.376970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a67dea-c85e-448e-a26f-d00cb4b91ff7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:56.387103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:56.410428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:56.411053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:56.411327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:56.411594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:56.412208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:56.413557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:05:56.422154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:05:56.423368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:05:56.424255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 644/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:05:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:05:56.429093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14a7af-21a5-4bd0-9c02-c095bd6aedc0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:56.522907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14a7af-21a5-4bd0-9c02-c095bd6aedc0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:56.555004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf4332-b13d-4c02-878b-8a1effd2f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:56.555599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf4332-b13d-4c02-878b-8a1effd2f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:56.555874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf4332-b13d-4c02-878b-8a1effd2f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:56.556139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf4332-b13d-4c02-878b-8a1effd2f3b9 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:56.556809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf4332-b13d-4c02-878b-8a1effd2f3b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:56.557095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf4332-b13d-4c02-878b-8a1effd2f3b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:56.558453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf4332-b13d-4c02-878b-8a1effd2f3b9 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:56.563623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 647/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 28 22:05:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:05:56.569176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:56.664848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec925fd-e47f-4a78-b8dd-3398ea10cec4 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:56.696571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f18e6e-8c25-48bc-83c1-3088009bede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:56.697167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f18e6e-8c25-48bc-83c1-3088009bede2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:56.697442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f18e6e-8c25-48bc-83c1-3088009bede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:56.697707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f18e6e-8c25-48bc-83c1-3088009bede2 None admin] PATH_INFO: `/v3/services` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:56.698389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f18e6e-8c25-48bc-83c1-3088009bede2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:05:56.698689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f18e6e-8c25-48bc-83c1-3088009bede2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:56.700612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f18e6e-8c25-48bc-83c1-3088009bede2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:56.704902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 645/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 28 22:05:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:05:58.671338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b18fd-3168-4130-806b-8ac454249f4d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:58.671934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b18fd-3168-4130-806b-8ac454249f4d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:58.671934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b18fd-3168-4130-806b-8ac454249f4d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:58.673209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 648/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:05:58.678159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5c52-851c-4ac2-9580-ef49dffff056 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:58.678582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5c52-851c-4ac2-9580-ef49dffff056 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:58.678741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa5c52-851c-4ac2-9580-ef49dffff056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:58.696989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d5fa5c52-851c-4ac2-9580-ef49dffff056 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:05:58.698165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d5fa5c52-851c-4ac2-9580-ef49dffff056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:05:58.726553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:58.763517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 646/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:05:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:05:58.785690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b18fd-3168-4130-806b-8ac454249f4d None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:05:58.817350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:05:58.893603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b18fd-3168-4130-806b-8ac454249f4d None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:05:58.926439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0af0ac-9f35-4ac4-9f85-3438445ac687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:05:58.926984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0af0ac-9f35-4ac4-9f85-3438445ac687 None admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:05:58.927257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0af0ac-9f35-4ac4-9f85-3438445ac687 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:05:58.927521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0af0ac-9f35-4ac4-9f85-3438445ac687 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:05:58.928203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0af0ac-9f35-4ac4-9f85-3438445ac687 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:05:58.929542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0af0ac-9f35-4ac4-9f85-3438445ac687 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:05:58.943448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 649/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 28 22:05:58 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:06:00.907510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f9c0-6fbc-4520-8093-ba44a1e2f842 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:00.908066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f9c0-6fbc-4520-8093-ba44a1e2f842 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:00.908066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f9c0-6fbc-4520-8093-ba44a1e2f842 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:00.909390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 647/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:06:00.914430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82878b7-3176-4d4a-a1fb-ceafa9c18240 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:00.914818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82878b7-3176-4d4a-a1fb-ceafa9c18240 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:00.914965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82878b7-3176-4d4a-a1fb-ceafa9c18240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:00.932967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f82878b7-3176-4d4a-a1fb-ceafa9c18240 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:06:00.934712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f82878b7-3176-4d4a-a1fb-ceafa9c18240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:06:01.003998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 650/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:06:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:06:01.027499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7f9c0-6fbc-4520-8093-ba44a1e2f842 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:06:01.133079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7f9c0-6fbc-4520-8093-ba44a1e2f842 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:06:01.166992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:06:01.167563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:01.167844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:01.168119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:01.169326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:06:01.170748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:06:01.179618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:06:01.180875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:06:01.181831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 648/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:06:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 22:06:01.187114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82878b7-3176-4d4a-a1fb-ceafa9c18240 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:06:01.205072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:06:01.286130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82878b7-3176-4d4a-a1fb-ceafa9c18240 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:06:01.320890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:06:01.321504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:01.321784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:01.322056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:01.322754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:06:01.323050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:06:01.324465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:06:01.330001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 651/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 28 22:06:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:06:01.337076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:06:01.370022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:06:01.442174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cf5fc-f73a-44d7-930f-38448b73b2d2 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:06:01.475419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe81a4-67d7-4e3a-8d1d-66e9228fafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:06:01.476031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe81a4-67d7-4e3a-8d1d-66e9228fafaf None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:01.476306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe81a4-67d7-4e3a-8d1d-66e9228fafaf None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:01.476573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe81a4-67d7-4e3a-8d1d-66e9228fafaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:01.477316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe81a4-67d7-4e3a-8d1d-66e9228fafaf None admin] RBAC: Adding query filter params (interface=public, service_id=eda3ca08bc214a898de6ab7aecfb4d12, region_id=RegionOne) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:06:01.477618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe81a4-67d7-4e3a-8d1d-66e9228fafaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:06:01.479005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe81a4-67d7-4e3a-8d1d-66e9228fafaf None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:06:01.484434 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 649/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 28 22:06:01 2022] GET /identity/v3/endpoints?service_id=eda3ca08bc214a898de6ab7aecfb4d12&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:06:01.490117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:06:01.573304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:06:01.591891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b7af1-630c-46ad-8280-a415e95386f0 None admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:06:01.626796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945797e8-ee29-440e-aeb1-31580085dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:06:01.627407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945797e8-ee29-440e-aeb1-31580085dc7c None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:01.627685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945797e8-ee29-440e-aeb1-31580085dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:01.627956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945797e8-ee29-440e-aeb1-31580085dc7c None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:01.628600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945797e8-ee29-440e-aeb1-31580085dc7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:06:01.629960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945797e8-ee29-440e-aeb1-31580085dc7c None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:06:01.636672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 652/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 28 22:06:01 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:06:03.616118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514188-7ad8-4ca8-a42d-7f521f8e6bd2 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:03.616651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514188-7ad8-4ca8-a42d-7f521f8e6bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:03.616651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514188-7ad8-4ca8-a42d-7f521f8e6bd2 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:03.617984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 650/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:06:03.623501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204c1b-d9e1-4440-b8e7-e4c0df95d4e3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:03.623921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204c1b-d9e1-4440-b8e7-e4c0df95d4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:03.624043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204c1b-d9e1-4440-b8e7-e4c0df95d4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:03.642695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-71204c1b-d9e1-4440-b8e7-e4c0df95d4e3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:06:03.643875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-71204c1b-d9e1-4440-b8e7-e4c0df95d4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:06:03.708102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 653/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:06:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 22:06:03.729932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514188-7ad8-4ca8-a42d-7f521f8e6bd2 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:06:03.825027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:06:03.833304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514188-7ad8-4ca8-a42d-7f521f8e6bd2 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:06:03.868240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:06:03.868811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:03.869091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:03.869362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:03.869981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:06:03.871973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 22:06:03.881235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 22:06:03.882412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application with Lock( Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self._enter() Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application return self.creator() Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application created_value = creator( Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: ERROR keystone.server.flask.application Jul 28 22:06:03.883442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 651/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 28 22:06:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 22:06:03.888526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204c1b-d9e1-4440-b8e7-e4c0df95d4e3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:06:03.960637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:06:03.983120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204c1b-d9e1-4440-b8e7-e4c0df95d4e3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:06:04.015831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214edb7a-a73c-43f6-bb74-1fca830f00ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:06:04.016431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214edb7a-a73c-43f6-bb74-1fca830f00ec None admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:04.016707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214edb7a-a73c-43f6-bb74-1fca830f00ec None admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:04.016975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214edb7a-a73c-43f6-bb74-1fca830f00ec None admin] PATH_INFO: `/v3/services` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:04.017634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214edb7a-a73c-43f6-bb74-1fca830f00ec None admin] RBAC: Adding query filter params (name=placement) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:06:04.017933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214edb7a-a73c-43f6-bb74-1fca830f00ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:06:04.019302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214edb7a-a73c-43f6-bb74-1fca830f00ec None admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:06:04.024206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 654/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 28 22:06:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:06:04.030324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:06:04.127182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8471-94a2-427b-8ddd-3556f3307512 None admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:06:04.161515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be8249-2217-47e1-8d66-813bd5e3cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:06:04.162128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8249-2217-47e1-8d66-813bd5e3cabf None admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:06:04.162431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8249-2217-47e1-8d66-813bd5e3cabf None admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:06:04.162701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8249-2217-47e1-8d66-813bd5e3cabf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:06:04.163393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be8249-2217-47e1-8d66-813bd5e3cabf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:06:04.164741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be8249-2217-47e1-8d66-813bd5e3cabf None admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:06:04.183505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 652/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:06:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:06:14.021284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=30 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:06:14.180057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:06.488780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9847a-c510-4a55-be7f-3402c8ce5eba None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:06.489280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9847a-c510-4a55-be7f-3402c8ce5eba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:06.489361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9847a-c510-4a55-be7f-3402c8ce5eba None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:06.495857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de6af-84cb-4a1e-bf24-fbf6af6da2ca None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:06.496266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de6af-84cb-4a1e-bf24-fbf6af6da2ca None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:06.496471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de6af-84cb-4a1e-bf24-fbf6af6da2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:06.499389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 655/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:06.579548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d39de6af-84cb-4a1e-bf24-fbf6af6da2ca None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:06.580742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d39de6af-84cb-4a1e-bf24-fbf6af6da2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:06.710677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 653/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:07:06.748544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ee2a-aff0-44f1-a822-61f1b7ec888c None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:06.748820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ee2a-aff0-44f1-a822-61f1b7ec888c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:06.749517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ee2a-aff0-44f1-a822-61f1b7ec888c None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:06.751763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 656/1309] 10.222.0.48 () {54 vars in 965 bytes} [Thu Jul 28 22:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:06.758043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe9d9-3cf7-457e-a263-7a102eb24a01 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:06.758357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe9d9-3cf7-457e-a263-7a102eb24a01 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:06.758635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe9d9-3cf7-457e-a263-7a102eb24a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:06.865646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-634fe9d9-3cf7-457e-a263-7a102eb24a01 None None] MFA Rules not processed for user `ba7594ae41184fb09cd2399b7f35616e`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:06.867113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-634fe9d9-3cf7-457e-a263-7a102eb24a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:06.890207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:06.951995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 654/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Jul 28 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:07:06.961030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3ee2a-aff0-44f1-a822-61f1b7ec888c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:06.962835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a3d3ee2a-aff0-44f1-a822-61f1b7ec888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:07.075153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3ee2a-aff0-44f1-a822-61f1b7ec888c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:07.161658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfec5a-f308-4721-8069-282d16f1b1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:07.162303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfec5a-f308-4721-8069-282d16f1b1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:07.162583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfec5a-f308-4721-8069-282d16f1b1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:07.162853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfec5a-f308-4721-8069-282d16f1b1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:07.164477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-64cfec5a-f308-4721-8069-282d16f1b1c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:07.222472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:07.281240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfec5a-f308-4721-8069-282d16f1b1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:07.282871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfec5a-f308-4721-8069-282d16f1b1c4 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:07.302642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 657/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:09.597914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2fc3-95bc-4dff-abaa-489c7e28286f None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:09.598485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2fc3-95bc-4dff-abaa-489c7e28286f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:09.598485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2fc3-95bc-4dff-abaa-489c7e28286f None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:09.599824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 655/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:09.605051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173052c-4a7a-4df3-89a1-981ae3e4add5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:09.605478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173052c-4a7a-4df3-89a1-981ae3e4add5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:09.605624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173052c-4a7a-4df3-89a1-981ae3e4add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:09.676778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3173052c-4a7a-4df3-89a1-981ae3e4add5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:09.677997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3173052c-4a7a-4df3-89a1-981ae3e4add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:09.774923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 658/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:09.830145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde49602-11aa-423a-ac1f-ff286ca75dff None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:09.830455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde49602-11aa-423a-ac1f-ff286ca75dff None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:09.830730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde49602-11aa-423a-ac1f-ff286ca75dff None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:09.832077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 656/1314] 10.222.0.48 () {54 vars in 965 bytes} [Thu Jul 28 22:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:09.838493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f29c-c286-4109-b9d7-bf4c2caba509 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:09.838781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f29c-c286-4109-b9d7-bf4c2caba509 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:09.839104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f29c-c286-4109-b9d7-bf4c2caba509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:09.851325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:09.927179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a334f29c-c286-4109-b9d7-bf4c2caba509 None None] MFA Rules not processed for user `ba7594ae41184fb09cd2399b7f35616e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:09.928392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a334f29c-c286-4109-b9d7-bf4c2caba509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:10.007196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 659/1315] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Jul 28 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:10.015942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde49602-11aa-423a-ac1f-ff286ca75dff None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:10.017470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fde49602-11aa-423a-ac1f-ff286ca75dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:10.130539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde49602-11aa-423a-ac1f-ff286ca75dff None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:10.206640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:10.209521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53376f-e307-4e79-98b2-3a153e9c43f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:10.210359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53376f-e307-4e79-98b2-3a153e9c43f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:10.210812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53376f-e307-4e79-98b2-3a153e9c43f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:10.211309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53376f-e307-4e79-98b2-3a153e9c43f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:10.212946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0c53376f-e307-4e79-98b2-3a153e9c43f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:10.320174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53376f-e307-4e79-98b2-3a153e9c43f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:10.321626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53376f-e307-4e79-98b2-3a153e9c43f7 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:10.341021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 657/1316] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:12.879639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc837f-b66c-4631-8410-8bb6e069e26b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:12.880178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc837f-b66c-4631-8410-8bb6e069e26b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:12.880178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc837f-b66c-4631-8410-8bb6e069e26b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:12.881525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 660/1317] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:12.887301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1c41d-22ad-41d5-854a-5e0d5f59d081 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:12.887711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1c41d-22ad-41d5-854a-5e0d5f59d081 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:12.887853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1c41d-22ad-41d5-854a-5e0d5f59d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:12.952915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-abc1c41d-22ad-41d5-854a-5e0d5f59d081 None None] MFA Rules not processed for user `75ab0515763a46178ee145ae4a916195`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:12.954133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-abc1c41d-22ad-41d5-854a-5e0d5f59d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:13.007069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:13.051619 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 658/1318] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:13.090871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc837f-b66c-4631-8410-8bb6e069e26b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:13.092434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-07fc837f-b66c-4631-8410-8bb6e069e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:13.194136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc837f-b66c-4631-8410-8bb6e069e26b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:13.197036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:13.265991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb962-cf27-4c04-97b6-d4354286c5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:13.266630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb962-cf27-4c04-97b6-d4354286c5ce service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:13.266907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb962-cf27-4c04-97b6-d4354286c5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:13.267173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb962-cf27-4c04-97b6-d4354286c5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:13.268806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6d5bb962-cf27-4c04-97b6-d4354286c5ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:13.373803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bb962-cf27-4c04-97b6-d4354286c5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:13.375244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bb962-cf27-4c04-97b6-d4354286c5ce service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:13.393683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 661/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:15.931478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c422d-2532-473d-a437-da35376f50e4 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:15.932018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c422d-2532-473d-a437-da35376f50e4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:15.932018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c422d-2532-473d-a437-da35376f50e4 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:15.933997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 659/1320] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:15.939136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4998a-2ab3-4d48-92fa-fcb6811fcbf1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:15.939536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4998a-2ab3-4d48-92fa-fcb6811fcbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:15.939687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4998a-2ab3-4d48-92fa-fcb6811fcbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:15.979173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:16.005514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e1f4998a-2ab3-4d48-92fa-fcb6811fcbf1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:16.006745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e1f4998a-2ab3-4d48-92fa-fcb6811fcbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:16.100795 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 662/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:16.138576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c422d-2532-473d-a437-da35376f50e4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:16.140104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-030c422d-2532-473d-a437-da35376f50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:16.241049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c422d-2532-473d-a437-da35376f50e4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:16.311906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb13e5-e863-4f12-83d1-3ba772905f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:16.312513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb13e5-e863-4f12-83d1-3ba772905f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:16.312786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb13e5-e863-4f12-83d1-3ba772905f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:16.313053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb13e5-e863-4f12-83d1-3ba772905f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:16.314677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9bcb13e5-e863-4f12-83d1-3ba772905f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:16.321841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:16.421292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb13e5-e863-4f12-83d1-3ba772905f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:16.422746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb13e5-e863-4f12-83d1-3ba772905f7d service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:16.440631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 660/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:19.073495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7eff8-3cd2-4a56-8fe4-12a69c420063 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:19.074034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7eff8-3cd2-4a56-8fe4-12a69c420063 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:19.074034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7eff8-3cd2-4a56-8fe4-12a69c420063 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:19.075440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 663/1323] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:19.086929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f9cfb-8085-4a7e-a905-46fe875e31b7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:19.087359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f9cfb-8085-4a7e-a905-46fe875e31b7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:19.087650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f9cfb-8085-4a7e-a905-46fe875e31b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:19.160511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-171f9cfb-8085-4a7e-a905-46fe875e31b7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:19.161724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-171f9cfb-8085-4a7e-a905-46fe875e31b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:19.218518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:19.259068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 661/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:19.296304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7eff8-3cd2-4a56-8fe4-12a69c420063 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:19.297858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-08f7eff8-3cd2-4a56-8fe4-12a69c420063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:19.407529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7eff8-3cd2-4a56-8fe4-12a69c420063 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:19.419871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:19.482916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97c784-1540-4aee-af2b-59b5101b4ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:19.483536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c784-1540-4aee-af2b-59b5101b4ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:19.483814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c784-1540-4aee-af2b-59b5101b4ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:19.484086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c784-1540-4aee-af2b-59b5101b4ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:19.485716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dc97c784-1540-4aee-af2b-59b5101b4ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:19.594199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97c784-1540-4aee-af2b-59b5101b4ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:19.595669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97c784-1540-4aee-af2b-59b5101b4ed7 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:19.613248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 664/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:21.675111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3746c-ea65-4b5f-8af8-0c376d1a3f3e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:21.675669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3746c-ea65-4b5f-8af8-0c376d1a3f3e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:21.675669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3746c-ea65-4b5f-8af8-0c376d1a3f3e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:21.677007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 662/1326] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:21.682221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3305-eb26-4a46-9573-401726aa7ecd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:21.682677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3305-eb26-4a46-9573-401726aa7ecd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:21.682957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3305-eb26-4a46-9573-401726aa7ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:21.732252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:21.750111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-176e3305-eb26-4a46-9573-401726aa7ecd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:21.751555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-176e3305-eb26-4a46-9573-401726aa7ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:21.850189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 665/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:21.885801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3746c-ea65-4b5f-8af8-0c376d1a3f3e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:21.887921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-acc3746c-ea65-4b5f-8af8-0c376d1a3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:21.990761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3746c-ea65-4b5f-8af8-0c376d1a3f3e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:22.065551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93417c80-fda2-4bfb-aad6-5923f139cd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:22.066171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93417c80-fda2-4bfb-aad6-5923f139cd72 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:22.066542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93417c80-fda2-4bfb-aad6-5923f139cd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:22.066881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93417c80-fda2-4bfb-aad6-5923f139cd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:22.068778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-93417c80-fda2-4bfb-aad6-5923f139cd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:22.086033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:22.190161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93417c80-fda2-4bfb-aad6-5923f139cd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:22.191618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93417c80-fda2-4bfb-aad6-5923f139cd72 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:22.209767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 663/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:24.267386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d30c-75b8-41a6-9ac5-766d6cf52032 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:24.267942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d30c-75b8-41a6-9ac5-766d6cf52032 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:24.267942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d30c-75b8-41a6-9ac5-766d6cf52032 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:24.269264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 666/1329] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:24.274362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8acb-ea30-41d0-887a-24c290ec27d4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:24.274820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8acb-ea30-41d0-887a-24c290ec27d4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:24.274923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8acb-ea30-41d0-887a-24c290ec27d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:24.340582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7dde8acb-ea30-41d0-887a-24c290ec27d4 None None] MFA Rules not processed for user `75ab0515763a46178ee145ae4a916195`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:24.341772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7dde8acb-ea30-41d0-887a-24c290ec27d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:24.406895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:24.441519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 664/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:24.479166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7d30c-75b8-41a6-9ac5-766d6cf52032 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:24.481300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e3a7d30c-75b8-41a6-9ac5-766d6cf52032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:24.587212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7d30c-75b8-41a6-9ac5-766d6cf52032 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:24.613565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:24.668621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97349-35c6-4ee8-9a5c-e0e4a2b61fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:24.669148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97349-35c6-4ee8-9a5c-e0e4a2b61fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:24.669425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97349-35c6-4ee8-9a5c-e0e4a2b61fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:24.669692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97349-35c6-4ee8-9a5c-e0e4a2b61fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:24.671359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2eb97349-35c6-4ee8-9a5c-e0e4a2b61fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:24.781731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97349-35c6-4ee8-9a5c-e0e4a2b61fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:24.783197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97349-35c6-4ee8-9a5c-e0e4a2b61fa9 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:24.801458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 667/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:27.052902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9189-1aeb-47f1-aa17-8ce69f73a448 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:27.053433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9189-1aeb-47f1-aa17-8ce69f73a448 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:27.053433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9189-1aeb-47f1-aa17-8ce69f73a448 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:27.054834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 665/1332] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:27.060468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe779ad-e26b-4370-9c5e-587636439dc1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:27.060843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe779ad-e26b-4370-9c5e-587636439dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:27.061017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe779ad-e26b-4370-9c5e-587636439dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:27.123585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:27.127050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1fe779ad-e26b-4370-9c5e-587636439dc1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:27.128724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1fe779ad-e26b-4370-9c5e-587636439dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:27.222472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 668/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:27.259569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9189-1aeb-47f1-aa17-8ce69f73a448 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:27.261098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-777c9189-1aeb-47f1-aa17-8ce69f73a448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:27.363398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9189-1aeb-47f1-aa17-8ce69f73a448 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:27.435481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afc4f5-d993-4f4f-b347-c8b0d33d55a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:27.436097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc4f5-d993-4f4f-b347-c8b0d33d55a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:27.436378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc4f5-d993-4f4f-b347-c8b0d33d55a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:27.436653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc4f5-d993-4f4f-b347-c8b0d33d55a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:27.438318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e1afc4f5-d993-4f4f-b347-c8b0d33d55a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:27.464040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:27.544899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afc4f5-d993-4f4f-b347-c8b0d33d55a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:27.546349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afc4f5-d993-4f4f-b347-c8b0d33d55a7 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:27.563727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 666/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:29.591714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dbd7-fddb-4030-a007-d65e464be11b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:29.592267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dbd7-fddb-4030-a007-d65e464be11b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:29.592267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240dbd7-fddb-4030-a007-d65e464be11b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:29.594055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 669/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:29.599218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bc2f6-f108-4991-b4f7-7c18573ee523 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:29.599645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bc2f6-f108-4991-b4f7-7c18573ee523 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:29.599757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bc2f6-f108-4991-b4f7-7c18573ee523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:29.666316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c46bc2f6-f108-4991-b4f7-7c18573ee523 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:29.667502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c46bc2f6-f108-4991-b4f7-7c18573ee523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:29.739715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:29.762987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 667/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:29.801546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240dbd7-fddb-4030-a007-d65e464be11b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:29.803136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a240dbd7-fddb-4030-a007-d65e464be11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:29.905108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240dbd7-fddb-4030-a007-d65e464be11b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:29.932810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:29.977201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8724e8-faff-4cea-ba39-8f92d7b9af6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:29.977818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8724e8-faff-4cea-ba39-8f92d7b9af6c service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:29.978093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8724e8-faff-4cea-ba39-8f92d7b9af6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:29.978396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8724e8-faff-4cea-ba39-8f92d7b9af6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:29.980532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bf8724e8-faff-4cea-ba39-8f92d7b9af6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:30.086503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8724e8-faff-4cea-ba39-8f92d7b9af6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:30.087932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8724e8-faff-4cea-ba39-8f92d7b9af6c service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:30.113492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 670/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:32.457185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77554db2-aefd-4822-bfb8-0eaca147dbbd None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:32.457721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77554db2-aefd-4822-bfb8-0eaca147dbbd None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:32.457721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77554db2-aefd-4822-bfb8-0eaca147dbbd None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:32.459053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 668/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:32.464876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcfc9-60e3-4534-87f5-c34fb055e906 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:32.465262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcfc9-60e3-4534-87f5-c34fb055e906 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:32.465430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcfc9-60e3-4534-87f5-c34fb055e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:32.531402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ceddcfc9-60e3-4534-87f5-c34fb055e906 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:32.532620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ceddcfc9-60e3-4534-87f5-c34fb055e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:32.540808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:32.628020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 671/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:32.664300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77554db2-aefd-4822-bfb8-0eaca147dbbd None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:32.665865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-77554db2-aefd-4822-bfb8-0eaca147dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:32.768014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77554db2-aefd-4822-bfb8-0eaca147dbbd None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:32.845775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e7649-b1f6-475e-b24b-7abf992ec7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:32.846413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7649-b1f6-475e-b24b-7abf992ec7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:32.846690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7649-b1f6-475e-b24b-7abf992ec7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:32.846963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7649-b1f6-475e-b24b-7abf992ec7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:32.848582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ad8e7649-b1f6-475e-b24b-7abf992ec7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:32.884637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:32.957312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e7649-b1f6-475e-b24b-7abf992ec7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:32.958782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e7649-b1f6-475e-b24b-7abf992ec7f7 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:32.976119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 669/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:36.865989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1112b28-b563-42d5-8703-6ffab746e678 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:36.866562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1112b28-b563-42d5-8703-6ffab746e678 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:36.866562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1112b28-b563-42d5-8703-6ffab746e678 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:36.867835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 672/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:36.873621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0756-386d-423a-9214-f85a558bb3cd None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:36.874095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0756-386d-423a-9214-f85a558bb3cd None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:36.874219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0756-386d-423a-9214-f85a558bb3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:36.941654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-44cc0756-386d-423a-9214-f85a558bb3cd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:36.942974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-44cc0756-386d-423a-9214-f85a558bb3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:37.029044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:37.040996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 670/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:37.079506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1112b28-b563-42d5-8703-6ffab746e678 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:37.081068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e1112b28-b563-42d5-8703-6ffab746e678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:37.186669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1112b28-b563-42d5-8703-6ffab746e678 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:37.224063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:37.260874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a179a-a72a-427c-b849-67ed09e0198b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:37.261483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a179a-a72a-427c-b849-67ed09e0198b service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:37.261756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a179a-a72a-427c-b849-67ed09e0198b service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:37.262021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a179a-a72a-427c-b849-67ed09e0198b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:37.263663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-144a179a-a72a-427c-b849-67ed09e0198b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:37.371594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a179a-a72a-427c-b849-67ed09e0198b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:37.373064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a179a-a72a-427c-b849-67ed09e0198b service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:37.391739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 673/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:40.052121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529faa77-65ab-4098-a515-77d89033bd2f None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:40.052706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529faa77-65ab-4098-a515-77d89033bd2f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:40.052706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529faa77-65ab-4098-a515-77d89033bd2f None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:40.054087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 671/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:40.059727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd47fd8-119e-4957-b7b1-59b0c7ab50b5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:40.060235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd47fd8-119e-4957-b7b1-59b0c7ab50b5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:40.060336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd47fd8-119e-4957-b7b1-59b0c7ab50b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:40.131744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bfd47fd8-119e-4957-b7b1-59b0c7ab50b5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:40.133493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bfd47fd8-119e-4957-b7b1-59b0c7ab50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:40.152616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:40.238092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 674/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:40.275044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529faa77-65ab-4098-a515-77d89033bd2f None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:40.276590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-529faa77-65ab-4098-a515-77d89033bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:40.379844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529faa77-65ab-4098-a515-77d89033bd2f None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:40.454494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014667a4-6883-4454-ab0d-70971de83346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:40.455122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014667a4-6883-4454-ab0d-70971de83346 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:40.455400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014667a4-6883-4454-ab0d-70971de83346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:40.455674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014667a4-6883-4454-ab0d-70971de83346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:40.457302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-014667a4-6883-4454-ab0d-70971de83346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:40.502870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:40.568054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014667a4-6883-4454-ab0d-70971de83346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:40.569477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014667a4-6883-4454-ab0d-70971de83346 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:40.588462 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 672/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:44.552168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e6ba1-7798-4578-9edf-afe1dcdd59c9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:44.552687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e6ba1-7798-4578-9edf-afe1dcdd59c9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:44.552687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e6ba1-7798-4578-9edf-afe1dcdd59c9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:44.554217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 675/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:44.560331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd396928-f41c-404c-a316-e95152828ac0 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:44.560785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd396928-f41c-404c-a316-e95152828ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:44.561013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd396928-f41c-404c-a316-e95152828ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:44.628294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fd396928-f41c-404c-a316-e95152828ac0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:44.629490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fd396928-f41c-404c-a316-e95152828ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:44.745036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:44.748602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 673/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:44.790023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e6ba1-7798-4578-9edf-afe1dcdd59c9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:44.791734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a02e6ba1-7798-4578-9edf-afe1dcdd59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:44.907449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e6ba1-7798-4578-9edf-afe1dcdd59c9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:07:44.957523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:44.984812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5765f9-29cc-42cf-94a1-0cda53bae5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:07:44.985446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5765f9-29cc-42cf-94a1-0cda53bae5ae service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:44.985727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5765f9-29cc-42cf-94a1-0cda53bae5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:44.985997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5765f9-29cc-42cf-94a1-0cda53bae5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:44.987695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7c5765f9-29cc-42cf-94a1-0cda53bae5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:45.111024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5765f9-29cc-42cf-94a1-0cda53bae5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:07:45.112644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5765f9-29cc-42cf-94a1-0cda53bae5ae service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:07:45.131815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 676/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:07:49.982829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e11b4-8a29-4001-ae99-da355bc0f94e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:49.983285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e11b4-8a29-4001-ae99-da355bc0f94e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:49.983367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e11b4-8a29-4001-ae99-da355bc0f94e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:49.985028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 674/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:49.990214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e1f31-7f2c-461b-b930-9eeb67589aa5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:49.990660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e1f31-7f2c-461b-b930-9eeb67589aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:49.990799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e1f31-7f2c-461b-b930-9eeb67589aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:50.130052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cf0e1f31-7f2c-461b-b930-9eeb67589aa5 None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:50.131275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cf0e1f31-7f2c-461b-b930-9eeb67589aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:50.155953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:50.254615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 677/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:07:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:54.338550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b76c0e-5413-45f8-a6b5-57a230520302 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:54.339121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b76c0e-5413-45f8-a6b5-57a230520302 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:54.339389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b76c0e-5413-45f8-a6b5-57a230520302 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:54.340953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 675/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:54.346323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a59d8-5cca-4781-ab72-0044d47cb09f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:54.346739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a59d8-5cca-4781-ab72-0044d47cb09f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:54.346926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a59d8-5cca-4781-ab72-0044d47cb09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:54.434906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-222a59d8-5cca-4781-ab72-0044d47cb09f None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:54.436060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-222a59d8-5cca-4781-ab72-0044d47cb09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:54.513052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:54.552265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 678/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:07:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:55.977963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c837dc-333c-4429-aa96-7f447b3f8598 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:55.978555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c837dc-333c-4429-aa96-7f447b3f8598 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:55.978675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c837dc-333c-4429-aa96-7f447b3f8598 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:55.980151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 676/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:55.985323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6853a9-12ff-4ddb-a48f-b1e95af20ab0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:55.985744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6853a9-12ff-4ddb-a48f-b1e95af20ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:55.985936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6853a9-12ff-4ddb-a48f-b1e95af20ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:56.065983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3c6853a9-12ff-4ddb-a48f-b1e95af20ab0 None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:56.067247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3c6853a9-12ff-4ddb-a48f-b1e95af20ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:56.184927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 679/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:07:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:07:59.408249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2584e2-caf3-43a8-812f-01ed8cd14c2b None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:59.409197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2584e2-caf3-43a8-812f-01ed8cd14c2b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:59.409684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2584e2-caf3-43a8-812f-01ed8cd14c2b None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:59.416162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 677/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:07:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:59.418091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae407e8-70bb-4062-b398-66f31a89593d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:59.418604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae407e8-70bb-4062-b398-66f31a89593d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:59.418706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae407e8-70bb-4062-b398-66f31a89593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:59.468034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:59.502190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-eae407e8-70bb-4062-b398-66f31a89593d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:59.503681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eae407e8-70bb-4062-b398-66f31a89593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:59.611456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 680/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:07:59.666785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c450a-328d-4a49-b8b8-ef3dcb067b57 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:59.667470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c450a-328d-4a49-b8b8-ef3dcb067b57 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:59.667956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c450a-328d-4a49-b8b8-ef3dcb067b57 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:59.670014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 678/1358] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 28 22:07:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:07:59.679215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edc61-2c65-49df-828b-4013c721e7b4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:07:59.680362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edc61-2c65-49df-828b-4013c721e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:07:59.681257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edc61-2c65-49df-828b-4013c721e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:07:59.763731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8a4edc61-2c65-49df-828b-4013c721e7b4 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:07:59.764923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8a4edc61-2c65-49df-828b-4013c721e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:07:59.815683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:07:59.890077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 681/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 28 22:07:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:07:59.897926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c450a-328d-4a49-b8b8-ef3dcb067b57 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:07:59.899460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4f1c450a-328d-4a49-b8b8-ef3dcb067b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:00.057679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c450a-328d-4a49-b8b8-ef3dcb067b57 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:00.139815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:00.182713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbce0f3-49e9-459f-84a2-9ae4403e7641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:00.183886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbce0f3-49e9-459f-84a2-9ae4403e7641 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:00.184163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbce0f3-49e9-459f-84a2-9ae4403e7641 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:00.184431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbce0f3-49e9-459f-84a2-9ae4403e7641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:00.186171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bcbce0f3-49e9-459f-84a2-9ae4403e7641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:00.279714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbce0f3-49e9-459f-84a2-9ae4403e7641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:00.281455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbce0f3-49e9-459f-84a2-9ae4403e7641 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:00.300765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 679/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:08:02.523738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7342a6e-93ee-4fe5-b1fc-c1be543d7772 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:02.524308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7342a6e-93ee-4fe5-b1fc-c1be543d7772 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:02.524308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7342a6e-93ee-4fe5-b1fc-c1be543d7772 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:02.526275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 682/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:02.532690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46823ad5-0434-4de6-9d24-5ebb0918f7f3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:02.533126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46823ad5-0434-4de6-9d24-5ebb0918f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:02.533227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46823ad5-0434-4de6-9d24-5ebb0918f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:02.603999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-46823ad5-0434-4de6-9d24-5ebb0918f7f3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:02.605254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-46823ad5-0434-4de6-9d24-5ebb0918f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:02.643931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:02.710277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 680/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:02.751096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7342a6e-93ee-4fe5-b1fc-c1be543d7772 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:02.752909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c7342a6e-93ee-4fe5-b1fc-c1be543d7772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:02.929151 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7342a6e-93ee-4fe5-b1fc-c1be543d7772 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:02.939725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:03.082279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b4c5-8dbb-4500-ab25-ed60e9712473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:03.082897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b4c5-8dbb-4500-ab25-ed60e9712473 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:03.083177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b4c5-8dbb-4500-ab25-ed60e9712473 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:03.083448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b4c5-8dbb-4500-ab25-ed60e9712473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:03.085130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bdd4b4c5-8dbb-4500-ab25-ed60e9712473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:03.188952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b4c5-8dbb-4500-ab25-ed60e9712473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:03.190799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b4c5-8dbb-4500-ab25-ed60e9712473 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:03.214412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 683/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:05.621462 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da203-d3e6-4161-9911-9ad5e40d7b8e None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:05.622033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da203-d3e6-4161-9911-9ad5e40d7b8e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:05.622033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da203-d3e6-4161-9911-9ad5e40d7b8e None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:05.623390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 681/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:05.628961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb448b-c285-473c-9e3a-f43c04c696d5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:05.629721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb448b-c285-473c-9e3a-f43c04c696d5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:05.630181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb448b-c285-473c-9e3a-f43c04c696d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:05.648482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:05.701645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2beb448b-c285-473c-9e3a-f43c04c696d5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:05.702884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2beb448b-c285-473c-9e3a-f43c04c696d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:05.805016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 684/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:05.864936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40a3d8-e196-4426-817e-b415b870e13b None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:05.865251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40a3d8-e196-4426-817e-b415b870e13b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:05.865491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40a3d8-e196-4426-817e-b415b870e13b None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:05.867179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 682/1366] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 28 22:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:05.873940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324291af-683e-4111-8f6d-96666b6476e5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:05.874246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324291af-683e-4111-8f6d-96666b6476e5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:05.874524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324291af-683e-4111-8f6d-96666b6476e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:05.960482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-324291af-683e-4111-8f6d-96666b6476e5 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:05.961678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-324291af-683e-4111-8f6d-96666b6476e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:05.999420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:06.086566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 685/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 28 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:06.094763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40a3d8-e196-4426-817e-b415b870e13b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:06.096423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cf40a3d8-e196-4426-817e-b415b870e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:06.269641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40a3d8-e196-4426-817e-b415b870e13b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:06.291704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:06.394676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23f895-e9ac-4ffa-8555-9b7707a61c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:06.395636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f895-e9ac-4ffa-8555-9b7707a61c56 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:06.396047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f895-e9ac-4ffa-8555-9b7707a61c56 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:06.396398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f895-e9ac-4ffa-8555-9b7707a61c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:06.398337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2d23f895-e9ac-4ffa-8555-9b7707a61c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:06.498634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23f895-e9ac-4ffa-8555-9b7707a61c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:06.500316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23f895-e9ac-4ffa-8555-9b7707a61c56 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:06.521629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 683/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:08:07.479367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2851-759b-402b-b52a-dac186f55cf4 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:07.479899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2851-759b-402b-b52a-dac186f55cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:07.479899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2851-759b-402b-b52a-dac186f55cf4 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:07.481399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 686/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:07.486483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701338d-c36e-4d79-8cd8-a9a948ba0b30 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:07.486919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701338d-c36e-4d79-8cd8-a9a948ba0b30 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:07.487090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701338d-c36e-4d79-8cd8-a9a948ba0b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:07.520228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:07.559658 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-a701338d-c36e-4d79-8cd8-a9a948ba0b30 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:07.560873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a701338d-c36e-4d79-8cd8-a9a948ba0b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:07.664448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 684/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:07.975603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb645-45f2-4d31-bd85-4bcfb207ba67 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:07.976047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb645-45f2-4d31-bd85-4bcfb207ba67 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:07.976443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fb645-45f2-4d31-bd85-4bcfb207ba67 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:07.977933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 687/1371] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jul 28 22:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:07.983698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635468-980e-4c37-a159-8d6e05190786 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:07.983986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635468-980e-4c37-a159-8d6e05190786 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:07.984259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635468-980e-4c37-a159-8d6e05190786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:08.063717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-52635468-980e-4c37-a159-8d6e05190786 None None] MFA Rules not processed for user `fccb9c8b7ba54808ab77499297173498`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:08.064928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-52635468-980e-4c37-a159-8d6e05190786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:08.119639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:08.158515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 685/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jul 28 22:08:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:08.165553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fb645-45f2-4d31-bd85-4bcfb207ba67 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:08.167117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a69fb645-45f2-4d31-bd85-4bcfb207ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:08.275062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fb645-45f2-4d31-bd85-4bcfb207ba67 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:08.317639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:08.356123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce9559-1a66-46b7-ba58-1a08d0d9dcb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:08.356743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce9559-1a66-46b7-ba58-1a08d0d9dcb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:08.357022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce9559-1a66-46b7-ba58-1a08d0d9dcb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:08.357293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce9559-1a66-46b7-ba58-1a08d0d9dcb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:08.358983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-35ce9559-1a66-46b7-ba58-1a08d0d9dcb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:08.480856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce9559-1a66-46b7-ba58-1a08d0d9dcb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:08.482322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce9559-1a66-46b7-ba58-1a08d0d9dcb1 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:08.501409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 688/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:08.579151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ebc1-a1f8-4cfc-97ba-3355d69673c0 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:08.579706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ebc1-a1f8-4cfc-97ba-3355d69673c0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:08.579942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ebc1-a1f8-4cfc-97ba-3355d69673c0 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:08.581614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 686/1374] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:08:08.586798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bfa17-5e5d-4727-abf9-be52b14b38b8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:08.587084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bfa17-5e5d-4727-abf9-be52b14b38b8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:08.587357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bfa17-5e5d-4727-abf9-be52b14b38b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:08.664649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b87bfa17-5e5d-4727-abf9-be52b14b38b8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:08.666274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b87bfa17-5e5d-4727-abf9-be52b14b38b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:08.693500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:08.790792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 689/1375] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:08.837415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ebc1-a1f8-4cfc-97ba-3355d69673c0 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:08.838967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3d90ebc1-a1f8-4cfc-97ba-3355d69673c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:09.009511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ebc1-a1f8-4cfc-97ba-3355d69673c0 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:09.061010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:09.131930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab76fdd-0ef4-4974-af14-348ed35baf4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:09.132574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76fdd-0ef4-4974-af14-348ed35baf4c service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:09.132856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76fdd-0ef4-4974-af14-348ed35baf4c service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:09.133197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76fdd-0ef4-4974-af14-348ed35baf4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:09.135122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8ab76fdd-0ef4-4974-af14-348ed35baf4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:09.229057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab76fdd-0ef4-4974-af14-348ed35baf4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:09.230711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab76fdd-0ef4-4974-af14-348ed35baf4c service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:09.248798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 687/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:11.271128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12c61-b778-4845-86c4-897ac9b4e801 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:11.271672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12c61-b778-4845-86c4-897ac9b4e801 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:11.271672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12c61-b778-4845-86c4-897ac9b4e801 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:11.273017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 690/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:11.278660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f3da-eb7e-47c2-8370-32657331f131 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:11.279047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f3da-eb7e-47c2-8370-32657331f131 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:11.279194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f3da-eb7e-47c2-8370-32657331f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:11.347779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-a668f3da-eb7e-47c2-8370-32657331f131 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:11.349020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a668f3da-eb7e-47c2-8370-32657331f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:11.355749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:11.458385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 688/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:11.504755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12c61-b778-4845-86c4-897ac9b4e801 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:11.506340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-25b12c61-b778-4845-86c4-897ac9b4e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:11.669157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12c61-b778-4845-86c4-897ac9b4e801 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:11.673182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:11.787767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bb59e-7510-4a3a-8847-f6c8892c3a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:11.788524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb59e-7510-4a3a-8847-f6c8892c3a8a service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:11.788814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb59e-7510-4a3a-8847-f6c8892c3a8a service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:11.789086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb59e-7510-4a3a-8847-f6c8892c3a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:11.790796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-701bb59e-7510-4a3a-8847-f6c8892c3a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:11.895699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bb59e-7510-4a3a-8847-f6c8892c3a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:11.898825 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bb59e-7510-4a3a-8847-f6c8892c3a8a service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:11.920905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 691/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:14.013833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430cca4-5fbc-46f8-80ce-fec7744364fc None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:14.014435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430cca4-5fbc-46f8-80ce-fec7744364fc None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:14.014599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430cca4-5fbc-46f8-80ce-fec7744364fc None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:14.016395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 689/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:14.022210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f201dd-4f89-442a-afbf-cee77049444d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:14.022775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f201dd-4f89-442a-afbf-cee77049444d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:14.022775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f201dd-4f89-442a-afbf-cee77049444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:14.035536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:14.094078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-78f201dd-4f89-442a-afbf-cee77049444d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:14.095306 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-78f201dd-4f89-442a-afbf-cee77049444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:14.209927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 692/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:14.255217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430cca4-5fbc-46f8-80ce-fec7744364fc None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:14.256770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b430cca4-5fbc-46f8-80ce-fec7744364fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:14.407274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:14.418698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430cca4-5fbc-46f8-80ce-fec7744364fc None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:14.539307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb1337-0ae7-4691-85da-bc11ad4cc897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:14.539927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1337-0ae7-4691-85da-bc11ad4cc897 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:14.540215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1337-0ae7-4691-85da-bc11ad4cc897 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:14.540488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1337-0ae7-4691-85da-bc11ad4cc897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:14.542123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3acb1337-0ae7-4691-85da-bc11ad4cc897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:14.639251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb1337-0ae7-4691-85da-bc11ad4cc897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:14.640378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb1337-0ae7-4691-85da-bc11ad4cc897 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:14.651126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:14.661233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 690/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:16.729189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63e66-81cb-484b-b63c-59f4effbdce4 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:16.729824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63e66-81cb-484b-b63c-59f4effbdce4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:16.729824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63e66-81cb-484b-b63c-59f4effbdce4 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:16.731247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 693/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:16.736663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6245-6036-4db1-b5f5-600ff7a7c902 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:16.737113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6245-6036-4db1-b5f5-600ff7a7c902 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:16.737208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6245-6036-4db1-b5f5-600ff7a7c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:16.809263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-dc0f6245-6036-4db1-b5f5-600ff7a7c902 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:16.810518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-dc0f6245-6036-4db1-b5f5-600ff7a7c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:16.922778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 691/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:16.965403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63e66-81cb-484b-b63c-59f4effbdce4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:16.967608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-50f63e66-81cb-484b-b63c-59f4effbdce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:17.069101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:17.143786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63e66-81cb-484b-b63c-59f4effbdce4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:17.265216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b5e06-c2f7-4920-9c47-964e073a288c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:17.265860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b5e06-c2f7-4920-9c47-964e073a288c service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:17.266139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b5e06-c2f7-4920-9c47-964e073a288c service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:17.266448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b5e06-c2f7-4920-9c47-964e073a288c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:17.268185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2a2b5e06-c2f7-4920-9c47-964e073a288c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:17.320652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:17.363121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b5e06-c2f7-4920-9c47-964e073a288c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:17.365490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b5e06-c2f7-4920-9c47-964e073a288c service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:17.389484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 694/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:19.394463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141437-3ecf-4b21-9aff-23cb41240aef None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:19.395102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141437-3ecf-4b21-9aff-23cb41240aef None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:19.395212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141437-3ecf-4b21-9aff-23cb41240aef None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:19.396989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 692/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:19.403355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5268e5e-a1c2-4e05-8265-9a519f69766c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:19.403820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5268e5e-a1c2-4e05-8265-9a519f69766c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:19.403916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5268e5e-a1c2-4e05-8265-9a519f69766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:19.478467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a5268e5e-a1c2-4e05-8265-9a519f69766c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:19.480265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a5268e5e-a1c2-4e05-8265-9a519f69766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:19.582380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 695/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:19.626846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61141437-3ecf-4b21-9aff-23cb41240aef None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:19.629297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-61141437-3ecf-4b21-9aff-23cb41240aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:19.706937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:19.795254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61141437-3ecf-4b21-9aff-23cb41240aef None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:19.929661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaffd0c-5c58-4cca-8551-332db2c42273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:19.930373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffd0c-5c58-4cca-8551-332db2c42273 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:19.930688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffd0c-5c58-4cca-8551-332db2c42273 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:19.930977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffd0c-5c58-4cca-8551-332db2c42273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:19.932913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-faaffd0c-5c58-4cca-8551-332db2c42273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:19.977983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:20.032594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaffd0c-5c58-4cca-8551-332db2c42273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:20.034219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaffd0c-5c58-4cca-8551-332db2c42273 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:20.053287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 693/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:22.160702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e93827-5e61-4417-9ab7-ab989f3e369b None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:22.161266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e93827-5e61-4417-9ab7-ab989f3e369b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:22.161266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e93827-5e61-4417-9ab7-ab989f3e369b None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:22.162643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 696/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:22.167904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947024f-2fb6-43aa-9bae-cc5518e95855 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:22.168333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947024f-2fb6-43aa-9bae-cc5518e95855 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:22.168475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947024f-2fb6-43aa-9bae-cc5518e95855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:22.237005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3947024f-2fb6-43aa-9bae-cc5518e95855 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:22.238206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3947024f-2fb6-43aa-9bae-cc5518e95855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:22.337125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 694/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:22.380809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e93827-5e61-4417-9ab7-ab989f3e369b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:22.382488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d9e93827-5e61-4417-9ab7-ab989f3e369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:22.413517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:22.527008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e93827-5e61-4417-9ab7-ab989f3e369b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:22.632828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:22.646818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd7a38-af7f-43e5-8335-5c85739c8eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:22.647447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7a38-af7f-43e5-8335-5c85739c8eac service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:22.647727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7a38-af7f-43e5-8335-5c85739c8eac service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:22.647999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7a38-af7f-43e5-8335-5c85739c8eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:22.649664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b9bd7a38-af7f-43e5-8335-5c85739c8eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:22.740522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd7a38-af7f-43e5-8335-5c85739c8eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:22.742043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd7a38-af7f-43e5-8335-5c85739c8eac service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:22.760022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 697/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:23.531713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f86a2f-2adf-4f6d-ae66-53fcb761c542 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:23.532248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f86a2f-2adf-4f6d-ae66-53fcb761c542 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:23.532248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f86a2f-2adf-4f6d-ae66-53fcb761c542 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:23.533580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 695/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:23.538833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209216f8-00f3-48b9-a4f0-a116733230bf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:23.539226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209216f8-00f3-48b9-a4f0-a116733230bf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:23.539377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209216f8-00f3-48b9-a4f0-a116733230bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:23.603732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-209216f8-00f3-48b9-a4f0-a116733230bf None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:23.605641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-209216f8-00f3-48b9-a4f0-a116733230bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:23.663037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:23.701421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 698/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:23.756829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d48a8-68c9-4044-a4bb-e31cfcf17490 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:23.757163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d48a8-68c9-4044-a4bb-e31cfcf17490 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:23.757439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d48a8-68c9-4044-a4bb-e31cfcf17490 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:23.758998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 696/1394] 10.222.0.48 () {54 vars in 966 bytes} [Thu Jul 28 22:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:23.763964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149f68-95b1-4d40-8490-34f1b4036d57 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:23.764249 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149f68-95b1-4d40-8490-34f1b4036d57 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:23.764522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149f68-95b1-4d40-8490-34f1b4036d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:23.846600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0d149f68-95b1-4d40-8490-34f1b4036d57 None None] MFA Rules not processed for user `a2718132c4914dbda4582e259eccbaef`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:23.847805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0d149f68-95b1-4d40-8490-34f1b4036d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:23.927248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 699/1395] 10.222.0.48 () {58 vars in 1063 bytes} [Thu Jul 28 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:23.934772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d48a8-68c9-4044-a4bb-e31cfcf17490 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:23.936292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-af3d48a8-68c9-4044-a4bb-e31cfcf17490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:23.950400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:24.040372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d48a8-68c9-4044-a4bb-e31cfcf17490 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:24.113456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c3c5d-cddd-4b16-989c-590ffc607170 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:24.114052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3c5d-cddd-4b16-989c-590ffc607170 service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:24.114362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3c5d-cddd-4b16-989c-590ffc607170 service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:24.114637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3c5d-cddd-4b16-989c-590ffc607170 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:24.116341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-672c3c5d-cddd-4b16-989c-590ffc607170 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:24.186761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:24.233153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c3c5d-cddd-4b16-989c-590ffc607170 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:24.234635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c3c5d-cddd-4b16-989c-590ffc607170 service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:24.252632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 697/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:24.784588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f012b1-1b6c-4a8a-b0dd-0d17d085653d None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:24.785130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f012b1-1b6c-4a8a-b0dd-0d17d085653d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:24.785130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f012b1-1b6c-4a8a-b0dd-0d17d085653d None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:24.786497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 700/1397] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:24.791586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:24.792024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:24.792135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:24.866461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:24.867714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:24.975761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 698/1398] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:24.992028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eefa8-148b-4675-bc74-c340a0c36caa None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:24.992343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eefa8-148b-4675-bc74-c340a0c36caa None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:24.992688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eefa8-148b-4675-bc74-c340a0c36caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:25.019678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:25.020890 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:25.047520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:25.067450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e42eefa8-148b-4675-bc74-c340a0c36caa None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:25.068700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e42eefa8-148b-4675-bc74-c340a0c36caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:25.077720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:25.140303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dade-823b-416d-9c57-22c6d0a60ce0 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:25.160780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 701/1399] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:25.209078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16435c5-c126-4021-986b-895f14f39138 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:25.209453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16435c5-c126-4021-986b-895f14f39138 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:25.209654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16435c5-c126-4021-986b-895f14f39138 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:25.211007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 702/1400] 10.222.0.48 () {54 vars in 943 bytes} [Thu Jul 28 22:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:08:25.217577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656684df-7ab8-40bc-9d08-56a3a0e9537c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:25.217890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656684df-7ab8-40bc-9d08-56a3a0e9537c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:25.218196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656684df-7ab8-40bc-9d08-56a3a0e9537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:25.261023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:25.262053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:25.262362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:25.262637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:25.264306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:25.282076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:25.295165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-656684df-7ab8-40bc-9d08-56a3a0e9537c None None] MFA Rules not processed for user `92ef4880fa1f413c8f553ebee43d4c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:25.296364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-656684df-7ab8-40bc-9d08-56a3a0e9537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:25.354577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:25.356211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:25.375270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 699/1401] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:08:25.381445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:25.405124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 703/1402] 10.222.0.48 () {58 vars in 1040 bytes} [Thu Jul 28 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:08:25.414394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:25.415591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:25.511721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3fc2-0c1e-4b63-96ca-fcdffbf11374 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:25.571743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:25.622141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6cc83-f3d1-4340-b698-f49949dd0995 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:25.622800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6cc83-f3d1-4340-b698-f49949dd0995 service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:25.623076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6cc83-f3d1-4340-b698-f49949dd0995 service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:25.623345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6cc83-f3d1-4340-b698-f49949dd0995 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:25.624989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-43b6cc83-f3d1-4340-b698-f49949dd0995 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:25.709628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6cc83-f3d1-4340-b698-f49949dd0995 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:25.711301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6cc83-f3d1-4340-b698-f49949dd0995 service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:25.720041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 700/1403] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:08:27.520599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5f3a4-c20b-41e1-9bed-7045b31ed9ec None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:27.521105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5f3a4-c20b-41e1-9bed-7045b31ed9ec None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:27.521105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5f3a4-c20b-41e1-9bed-7045b31ed9ec None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:27.522451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 704/1404] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:27.528690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e1c76-bfc7-4cbd-8852-db5208911aa5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:27.528690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e1c76-bfc7-4cbd-8852-db5208911aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:27.528690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e1c76-bfc7-4cbd-8852-db5208911aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:27.598867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3c2e1c76-bfc7-4cbd-8852-db5208911aa5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:27.600097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3c2e1c76-bfc7-4cbd-8852-db5208911aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:27.642253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:27.706354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 701/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:27.750334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5f3a4-c20b-41e1-9bed-7045b31ed9ec None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:27.752165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eed5f3a4-c20b-41e1-9bed-7045b31ed9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:27.914022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5f3a4-c20b-41e1-9bed-7045b31ed9ec None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:27.982488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:28.046181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212fcc9-d35c-42e5-ba19-0abdabc517ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:28.047143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212fcc9-d35c-42e5-ba19-0abdabc517ed service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:28.047726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212fcc9-d35c-42e5-ba19-0abdabc517ed service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:28.048179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212fcc9-d35c-42e5-ba19-0abdabc517ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:28.051573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5212fcc9-d35c-42e5-ba19-0abdabc517ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:28.154496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212fcc9-d35c-42e5-ba19-0abdabc517ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:28.156094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212fcc9-d35c-42e5-ba19-0abdabc517ed service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:28.175680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 705/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:30.231798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eece4-5901-443b-a3aa-f0fa2823d88b None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:30.232706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eece4-5901-443b-a3aa-f0fa2823d88b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:30.233251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eece4-5901-443b-a3aa-f0fa2823d88b None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:30.235382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 702/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:30.240408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ec8f-4dfb-450a-815a-dccad677d96b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:30.240837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ec8f-4dfb-450a-815a-dccad677d96b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:30.241020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ec8f-4dfb-450a-815a-dccad677d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:30.314494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-efc4ec8f-4dfb-450a-815a-dccad677d96b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:30.316017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-efc4ec8f-4dfb-450a-815a-dccad677d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:30.339121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:30.426765 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 706/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:30.472168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eece4-5901-443b-a3aa-f0fa2823d88b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:30.473773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-187eece4-5901-443b-a3aa-f0fa2823d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:30.644469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eece4-5901-443b-a3aa-f0fa2823d88b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:30.673323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:30.777473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba8639-a39f-4765-a1c9-13841409afe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:30.778224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8639-a39f-4765-a1c9-13841409afe8 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:30.778625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8639-a39f-4765-a1c9-13841409afe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:30.779002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8639-a39f-4765-a1c9-13841409afe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:30.780869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6cba8639-a39f-4765-a1c9-13841409afe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:30.931711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8639-a39f-4765-a1c9-13841409afe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:30.934019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8639-a39f-4765-a1c9-13841409afe8 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:30.954298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 703/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:40.424751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=35 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:40.951135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=87 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:47.768807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07743e6-5248-43db-98f4-c0f3fb2f92e6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:47.769380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07743e6-5248-43db-98f4-c0f3fb2f92e6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:47.769380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07743e6-5248-43db-98f4-c0f3fb2f92e6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:47.770881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 707/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jul 28 22:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:47.776028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3506240-72e0-40b8-ae7f-4e08ed51c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:47.776436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3506240-72e0-40b8-ae7f-4e08ed51c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:47.776600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3506240-72e0-40b8-ae7f-4e08ed51c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:47.850118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-b3506240-72e0-40b8-ae7f-4e08ed51c7d8 None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:47.851364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b3506240-72e0-40b8-ae7f-4e08ed51c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:47.965640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 704/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jul 28 22:08:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:47.980514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3054378-ea89-4817-9104-958c7a838ea9 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:47.980820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3054378-ea89-4817-9104-958c7a838ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:47.981176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3054378-ea89-4817-9104-958c7a838ea9 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:47.982569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 708/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jul 28 22:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:47.987315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8218-84cd-4cff-aece-d350e7f2918c None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:47.987599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8218-84cd-4cff-aece-d350e7f2918c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:47.987869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8218-84cd-4cff-aece-d350e7f2918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:48.059219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:48.062344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-353c8218-84cd-4cff-aece-d350e7f2918c None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:48.064149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-353c8218-84cd-4cff-aece-d350e7f2918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:48.178412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 705/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jul 28 22:08:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:08:50.627093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1d4d1-5811-4eb3-8f5a-e3d01cdb1ad5 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:50.627659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1d4d1-5811-4eb3-8f5a-e3d01cdb1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:50.627659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1d4d1-5811-4eb3-8f5a-e3d01cdb1ad5 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:50.628967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:50.634624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb4e9-bffa-45c8-87fe-1db7a2e38123 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:50.635062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb4e9-bffa-45c8-87fe-1db7a2e38123 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:50.635180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb4e9-bffa-45c8-87fe-1db7a2e38123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:50.699938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-357cb4e9-bffa-45c8-87fe-1db7a2e38123 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:50.701129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-357cb4e9-bffa-45c8-87fe-1db7a2e38123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:50.753780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:50.796219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:50.838824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1d4d1-5811-4eb3-8f5a-e3d01cdb1ad5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:50.840869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eea1d4d1-5811-4eb3-8f5a-e3d01cdb1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:50.984906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1d4d1-5811-4eb3-8f5a-e3d01cdb1ad5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:51.057021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:51.096337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f508bf-02d0-49c1-8142-20073e644a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:51.096943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f508bf-02d0-49c1-8142-20073e644a0f service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:51.097217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f508bf-02d0-49c1-8142-20073e644a0f service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:51.097482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f508bf-02d0-49c1-8142-20073e644a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:51.099125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d4f508bf-02d0-49c1-8142-20073e644a0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:51.185569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f508bf-02d0-49c1-8142-20073e644a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:51.187177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f508bf-02d0-49c1-8142-20073e644a0f service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:51.205110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 710/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:52.098194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee533b-b998-4a90-b523-4867aafae302 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:52.098812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee533b-b998-4a90-b523-4867aafae302 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:52.098812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee533b-b998-4a90-b523-4867aafae302 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:52.100168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:52.105965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969413-eab2-46e0-ad10-5db4da4dab5a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:52.106434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969413-eab2-46e0-ad10-5db4da4dab5a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:52.106549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969413-eab2-46e0-ad10-5db4da4dab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:52.181421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a8969413-eab2-46e0-ad10-5db4da4dab5a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:52.182650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a8969413-eab2-46e0-ad10-5db4da4dab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:52.209310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:52.278794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:52.428755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee533b-b998-4a90-b523-4867aafae302 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:52.430223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-21ee533b-b998-4a90-b523-4867aafae302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:52.578124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee533b-b998-4a90-b523-4867aafae302 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:52.617253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:52.688497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed193519-09f1-455f-bf82-db05170bb147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:52.689044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193519-09f1-455f-bf82-db05170bb147 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:52.689320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193519-09f1-455f-bf82-db05170bb147 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:52.689590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed193519-09f1-455f-bf82-db05170bb147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:52.691232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ed193519-09f1-455f-bf82-db05170bb147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:52.780873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193519-09f1-455f-bf82-db05170bb147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:52.782536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed193519-09f1-455f-bf82-db05170bb147 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:52.800045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 708/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:53.680784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c442e-dda4-4bd7-9f47-0df3ffce8ca0 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:53.681324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c442e-dda4-4bd7-9f47-0df3ffce8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:53.681324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c442e-dda4-4bd7-9f47-0df3ffce8ca0 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:53.682724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:53.687962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9030-9a1d-40f5-a4e3-c2b954400c2c None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:53.688370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9030-9a1d-40f5-a4e3-c2b954400c2c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:53.688510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf9030-9a1d-40f5-a4e3-c2b954400c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:53.742615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:53.765660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7adf9030-9a1d-40f5-a4e3-c2b954400c2c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:53.766885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7adf9030-9a1d-40f5-a4e3-c2b954400c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:53.865180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:54.016787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c442e-dda4-4bd7-9f47-0df3ffce8ca0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:54.018238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a80c442e-dda4-4bd7-9f47-0df3ffce8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:54.162929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c442e-dda4-4bd7-9f47-0df3ffce8ca0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:54.174831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:54.275203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe8a6-402a-451b-8322-205a17bf5b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:54.275752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe8a6-402a-451b-8322-205a17bf5b1c service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:54.276029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe8a6-402a-451b-8322-205a17bf5b1c service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:54.276297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe8a6-402a-451b-8322-205a17bf5b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:54.278536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b5cfe8a6-402a-451b-8322-205a17bf5b1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:54.365674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfe8a6-402a-451b-8322-205a17bf5b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:54.367305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfe8a6-402a-451b-8322-205a17bf5b1c service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:54.385519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 713/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:55.266390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ec50-db6a-4dc6-ba0c-1410b39dffab None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:55.266951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ec50-db6a-4dc6-ba0c-1410b39dffab None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:55.266951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ec50-db6a-4dc6-ba0c-1410b39dffab None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:55.268294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:55.273145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e187bd6-8abf-409c-8fb8-4db866ffe237 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:55.273574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e187bd6-8abf-409c-8fb8-4db866ffe237 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:55.273712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e187bd6-8abf-409c-8fb8-4db866ffe237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:55.294161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:55.350131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0e187bd6-8abf-409c-8fb8-4db866ffe237 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:55.351359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0e187bd6-8abf-409c-8fb8-4db866ffe237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:55.444585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:08:55.596526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9ec50-db6a-4dc6-ba0c-1410b39dffab None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:55.598064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-10c9ec50-db6a-4dc6-ba0c-1410b39dffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:55.706844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:55.742410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9ec50-db6a-4dc6-ba0c-1410b39dffab None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:55.855881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6173-ffde-4096-a7d3-8ff1b9a8fb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:55.856505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6173-ffde-4096-a7d3-8ff1b9a8fb3f service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:55.856804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6173-ffde-4096-a7d3-8ff1b9a8fb3f service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:55.857072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6173-ffde-4096-a7d3-8ff1b9a8fb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:55.858746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-65fe6173-ffde-4096-a7d3-8ff1b9a8fb3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:55.943523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:55.958333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6173-ffde-4096-a7d3-8ff1b9a8fb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:55.959884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6173-ffde-4096-a7d3-8ff1b9a8fb3f service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:55.979233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 711/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:56.835165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449d04d-d774-4a74-86ac-11b46068ee33 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:56.835714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449d04d-d774-4a74-86ac-11b46068ee33 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:56.835714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449d04d-d774-4a74-86ac-11b46068ee33 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:56.837085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:56.842684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ff70-7721-4b3d-ad7b-11e3a8773aef None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:56.843217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ff70-7721-4b3d-ad7b-11e3a8773aef None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:56.843217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ff70-7721-4b3d-ad7b-11e3a8773aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:56.919901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2fa0ff70-7721-4b3d-ad7b-11e3a8773aef None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:56.921121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2fa0ff70-7721-4b3d-ad7b-11e3a8773aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:57.017749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:57.166943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449d04d-d774-4a74-86ac-11b46068ee33 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:57.169033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3449d04d-d774-4a74-86ac-11b46068ee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:57.251991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:57.314373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449d04d-d774-4a74-86ac-11b46068ee33 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:57.425901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ee004-9590-4002-86d5-666115bfa84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:57.426472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee004-9590-4002-86d5-666115bfa84b service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:57.426751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee004-9590-4002-86d5-666115bfa84b service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:57.427017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee004-9590-4002-86d5-666115bfa84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:57.428650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-273ee004-9590-4002-86d5-666115bfa84b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:57.475525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:57.516712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ee004-9590-4002-86d5-666115bfa84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:57.518333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ee004-9590-4002-86d5-666115bfa84b service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:57.536206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 716/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:58.336163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fa07-2bfd-40c2-a903-d02421b31a34 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:58.336734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fa07-2bfd-40c2-a903-d02421b31a34 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:58.336734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53fa07-2bfd-40c2-a903-d02421b31a34 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:58.338091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:58.343144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010e22-309d-4331-9eb4-e3d35b4452ad None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:58.343555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010e22-309d-4331-9eb4-e3d35b4452ad None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:58.343702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010e22-309d-4331-9eb4-e3d35b4452ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:58.419180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f0010e22-309d-4331-9eb4-e3d35b4452ad None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:58.420321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0010e22-309d-4331-9eb4-e3d35b4452ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:58.514914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:08:58.664929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53fa07-2bfd-40c2-a903-d02421b31a34 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:08:58.666554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-af53fa07-2bfd-40c2-a903-d02421b31a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:58.715127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:58.811889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53fa07-2bfd-40c2-a903-d02421b31a34 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:08:58.927912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2ae7a-9b64-4f94-8b48-81f7ebcdff73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:08:58.928534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ae7a-9b64-4f94-8b48-81f7ebcdff73 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:58.928838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ae7a-9b64-4f94-8b48-81f7ebcdff73 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:58.929111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ae7a-9b64-4f94-8b48-81f7ebcdff73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:58.930837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5ea2ae7a-9b64-4f94-8b48-81f7ebcdff73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:08:58.937722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:08:59.022115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2ae7a-9b64-4f94-8b48-81f7ebcdff73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:08:59.023668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2ae7a-9b64-4f94-8b48-81f7ebcdff73 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:08:59.041713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 714/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:08:59.849445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d968c-6cc7-4246-8259-6f8c0245caae None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:59.849996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d968c-6cc7-4246-8259-6f8c0245caae None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:59.849996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d968c-6cc7-4246-8259-6f8c0245caae None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:59.851434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:08:59.856394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51adb4c-06d2-4120-9d81-90f584278abb None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:08:59.856810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51adb4c-06d2-4120-9d81-90f584278abb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:08:59.856941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51adb4c-06d2-4120-9d81-90f584278abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:08:59.932335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e51adb4c-06d2-4120-9d81-90f584278abb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:08:59.934073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e51adb4c-06d2-4120-9d81-90f584278abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:00.001269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:00.030179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:00.183650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d968c-6cc7-4246-8259-6f8c0245caae None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:00.185254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3f0d968c-6cc7-4246-8259-6f8c0245caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:00.202588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:00.329787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d968c-6cc7-4246-8259-6f8c0245caae None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:00.415170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:00.441222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72cad8-d454-4928-82d1-0af5976f18ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:00.441838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72cad8-d454-4928-82d1-0af5976f18ba service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:00.442114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72cad8-d454-4928-82d1-0af5976f18ba service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:00.442414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72cad8-d454-4928-82d1-0af5976f18ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:00.444047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2c72cad8-d454-4928-82d1-0af5976f18ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:00.531223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72cad8-d454-4928-82d1-0af5976f18ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:00.532828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72cad8-d454-4928-82d1-0af5976f18ba service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:00.550460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 719/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:01.358511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fb4ad-c91b-437c-b941-76dbab6b3d87 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:01.359082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fb4ad-c91b-437c-b941-76dbab6b3d87 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:01.359082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fb4ad-c91b-437c-b941-76dbab6b3d87 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:01.360479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:01.365274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd717-5ae7-4867-9d87-7eddbc7fb5c0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:01.365702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd717-5ae7-4867-9d87-7eddbc7fb5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:01.365822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd717-5ae7-4867-9d87-7eddbc7fb5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:01.440679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c16cd717-5ae7-4867-9d87-7eddbc7fb5c0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:01.441836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c16cd717-5ae7-4867-9d87-7eddbc7fb5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:01.482526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:01.537143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:01.689445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fb4ad-c91b-437c-b941-76dbab6b3d87 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:01.691073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f27fb4ad-c91b-437c-b941-76dbab6b3d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:01.835878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fb4ad-c91b-437c-b941-76dbab6b3d87 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:01.889629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:01.947344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2f13a-1fcd-40bb-8580-361e7bdf8eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:01.947874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f13a-1fcd-40bb-8580-361e7bdf8eb0 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:01.948151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f13a-1fcd-40bb-8580-361e7bdf8eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:01.948972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f13a-1fcd-40bb-8580-361e7bdf8eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:01.950624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6ca2f13a-1fcd-40bb-8580-361e7bdf8eb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:02.045065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2f13a-1fcd-40bb-8580-361e7bdf8eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:02.046705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2f13a-1fcd-40bb-8580-361e7bdf8eb0 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:02.064704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 717/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:02.873853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05ee3-b3c8-44bc-8246-3ed389fa4ee8 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:02.874424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05ee3-b3c8-44bc-8246-3ed389fa4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:02.874424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05ee3-b3c8-44bc-8246-3ed389fa4ee8 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:02.875842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:02.881114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116fb7-2d39-4b91-a2e0-fd23e3aa46a4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:02.881534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116fb7-2d39-4b91-a2e0-fd23e3aa46a4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:02.881671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116fb7-2d39-4b91-a2e0-fd23e3aa46a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:02.958467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-6d116fb7-2d39-4b91-a2e0-fd23e3aa46a4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:02.959678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6d116fb7-2d39-4b91-a2e0-fd23e3aa46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:02.961670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:03.057174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:03.204830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05ee3-b3c8-44bc-8246-3ed389fa4ee8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:03.206403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1dd05ee3-b3c8-44bc-8246-3ed389fa4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:03.357023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05ee3-b3c8-44bc-8246-3ed389fa4ee8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:03.385532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:03.595595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8936a91-bfd4-43c9-94fc-f9f09f85ca08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:03.596231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8936a91-bfd4-43c9-94fc-f9f09f85ca08 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:03.596500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8936a91-bfd4-43c9-94fc-f9f09f85ca08 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:03.596762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8936a91-bfd4-43c9-94fc-f9f09f85ca08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:03.598484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f8936a91-bfd4-43c9-94fc-f9f09f85ca08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:03.685361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8936a91-bfd4-43c9-94fc-f9f09f85ca08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:03.686964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8936a91-bfd4-43c9-94fc-f9f09f85ca08 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:03.704280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 722/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:05.599259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c11f9-4fe0-47d5-8aa8-e81bfa9ea0c1 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:05.599817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c11f9-4fe0-47d5-8aa8-e81bfa9ea0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:05.599817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c11f9-4fe0-47d5-8aa8-e81bfa9ea0c1 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:05.601135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:05.606846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4a6ed-f309-4264-8ef7-5841f0b548c9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:05.607277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4a6ed-f309-4264-8ef7-5841f0b548c9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:05.607418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4a6ed-f309-4264-8ef7-5841f0b548c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:05.647108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:05.673057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-efa4a6ed-f309-4264-8ef7-5841f0b548c9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:05.674275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-efa4a6ed-f309-4264-8ef7-5841f0b548c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:05.767643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:05.805942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c11f9-4fe0-47d5-8aa8-e81bfa9ea0c1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:05.807555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-364c11f9-4fe0-47d5-8aa8-e81bfa9ea0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:05.915494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c11f9-4fe0-47d5-8aa8-e81bfa9ea0c1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:05.946895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:05.987602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a0f24-a429-40f2-9ab2-9e00fe723f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:05.988213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a0f24-a429-40f2-9ab2-9e00fe723f13 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:05.988492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a0f24-a429-40f2-9ab2-9e00fe723f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:05.988760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a0f24-a429-40f2-9ab2-9e00fe723f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:05.990407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-601a0f24-a429-40f2-9ab2-9e00fe723f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:06.097134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a0f24-a429-40f2-9ab2-9e00fe723f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:06.098640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a0f24-a429-40f2-9ab2-9e00fe723f13 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:06.116999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 720/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:08.265035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6861-fe1d-4790-a22d-6d653e468602 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:08.265576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6861-fe1d-4790-a22d-6d653e468602 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:08.265682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6861-fe1d-4790-a22d-6d653e468602 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:08.266983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:08.272092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96a3f-61e5-4e19-9b16-5bf4ecc9ccfb None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:08.272554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96a3f-61e5-4e19-9b16-5bf4ecc9ccfb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:08.272665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96a3f-61e5-4e19-9b16-5bf4ecc9ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:08.339595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-eee96a3f-61e5-4e19-9b16-5bf4ecc9ccfb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:08.340814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-eee96a3f-61e5-4e19-9b16-5bf4ecc9ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:08.353316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:08.437870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:08.476475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6861-fe1d-4790-a22d-6d653e468602 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:08.478047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f7ae6861-fe1d-4790-a22d-6d653e468602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:08.582425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6861-fe1d-4790-a22d-6d653e468602 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:08.595467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:08.656515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3317ffc-48a0-4e98-a5cc-208cb779d1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:08.657124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3317ffc-48a0-4e98-a5cc-208cb779d1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:08.657398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3317ffc-48a0-4e98-a5cc-208cb779d1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:08.657666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3317ffc-48a0-4e98-a5cc-208cb779d1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:08.659479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d3317ffc-48a0-4e98-a5cc-208cb779d1e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:08.766044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3317ffc-48a0-4e98-a5cc-208cb779d1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:08.767411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3317ffc-48a0-4e98-a5cc-208cb779d1e0 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:08.785152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 725/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:11.070904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa9d3-a6e5-4c9c-bcb9-9958e81d1049 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:11.071447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa9d3-a6e5-4c9c-bcb9-9958e81d1049 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:11.071447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa9d3-a6e5-4c9c-bcb9-9958e81d1049 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:11.072797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:11.078483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312494c-5dc1-47de-9789-fa2745173151 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:11.078971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312494c-5dc1-47de-9789-fa2745173151 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:11.079082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312494c-5dc1-47de-9789-fa2745173151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:11.126849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:11.146558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6312494c-5dc1-47de-9789-fa2745173151 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:11.147764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6312494c-5dc1-47de-9789-fa2745173151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:11.241203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:11.281932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa9d3-a6e5-4c9c-bcb9-9958e81d1049 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:11.283561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-133aa9d3-a6e5-4c9c-bcb9-9958e81d1049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:11.388705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa9d3-a6e5-4c9c-bcb9-9958e81d1049 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:11.427739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:11.461405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7dfa-9950-4bb9-af56-be7cc68011a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:11.462023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7dfa-9950-4bb9-af56-be7cc68011a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:11.462330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7dfa-9950-4bb9-af56-be7cc68011a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:11.462606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7dfa-9950-4bb9-af56-be7cc68011a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:11.464258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8c9a7dfa-9950-4bb9-af56-be7cc68011a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:11.578504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7dfa-9950-4bb9-af56-be7cc68011a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:11.579945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7dfa-9950-4bb9-af56-be7cc68011a8 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:11.598150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 723/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:13.706298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef362-9e3d-47f4-9981-499a120500b7 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:13.706892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef362-9e3d-47f4-9981-499a120500b7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:13.706892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef362-9e3d-47f4-9981-499a120500b7 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:13.708219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:13.713496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3bc4f-f292-46b2-af7b-289397f7571a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:13.714538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3bc4f-f292-46b2-af7b-289397f7571a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:13.714714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3bc4f-f292-46b2-af7b-289397f7571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:13.779506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-5cc3bc4f-f292-46b2-af7b-289397f7571a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:13.780708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5cc3bc4f-f292-46b2-af7b-289397f7571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:13.800528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:13.880832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:13.918503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef362-9e3d-47f4-9981-499a120500b7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:13.920037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0eaef362-9e3d-47f4-9981-499a120500b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:14.020737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef362-9e3d-47f4-9981-499a120500b7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:14.040111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:14.093264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50256-3072-4156-9d1d-51826aac39e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:14.093881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50256-3072-4156-9d1d-51826aac39e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:14.094157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50256-3072-4156-9d1d-51826aac39e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:14.094457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50256-3072-4156-9d1d-51826aac39e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:14.096123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-07d50256-3072-4156-9d1d-51826aac39e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:14.205153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50256-3072-4156-9d1d-51826aac39e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:14.206623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50256-3072-4156-9d1d-51826aac39e5 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:14.224991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 728/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:16.303940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188f63-5758-4751-924b-358b325e70c2 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:16.304454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188f63-5758-4751-924b-358b325e70c2 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:16.304551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188f63-5758-4751-924b-358b325e70c2 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:16.305810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:16.311508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b5237-a8d9-4c92-a616-80eed2a3fec7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:16.311939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b5237-a8d9-4c92-a616-80eed2a3fec7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:16.312053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b5237-a8d9-4c92-a616-80eed2a3fec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:16.374117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:16.377116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-130b5237-a8d9-4c92-a616-80eed2a3fec7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:16.378966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-130b5237-a8d9-4c92-a616-80eed2a3fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:16.472840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:16.511208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58188f63-5758-4751-924b-358b325e70c2 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:16.512769 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-58188f63-5758-4751-924b-358b325e70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:16.615195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58188f63-5758-4751-924b-358b325e70c2 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:16.663581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:16.688809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c8998-d684-4e5a-90cc-5410bb081401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:16.689424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8998-d684-4e5a-90cc-5410bb081401 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:16.689703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8998-d684-4e5a-90cc-5410bb081401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:16.689974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8998-d684-4e5a-90cc-5410bb081401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:16.691633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d69c8998-d684-4e5a-90cc-5410bb081401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:16.799834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c8998-d684-4e5a-90cc-5410bb081401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:16.801190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c8998-d684-4e5a-90cc-5410bb081401 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:16.819413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 726/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:19.001779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47f3b-4bed-4e3b-ac8a-b60e72738d51 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:19.002380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47f3b-4bed-4e3b-ac8a-b60e72738d51 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:19.002380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47f3b-4bed-4e3b-ac8a-b60e72738d51 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:19.003746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:19.009310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426098-a0f6-445a-8591-8be12a8b6bd9 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:19.009746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426098-a0f6-445a-8591-8be12a8b6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:19.009854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426098-a0f6-445a-8591-8be12a8b6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:19.075850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d0426098-a0f6-445a-8591-8be12a8b6bd9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:19.077060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d0426098-a0f6-445a-8591-8be12a8b6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:19.107201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:19.176067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:19.214611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47f3b-4bed-4e3b-ac8a-b60e72738d51 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:19.216147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3ea47f3b-4bed-4e3b-ac8a-b60e72738d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:19.317024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47f3b-4bed-4e3b-ac8a-b60e72738d51 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:19.344780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:19.390949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271bf3d-454a-4a67-b190-b41699bc3402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:19.391564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271bf3d-454a-4a67-b190-b41699bc3402 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:19.391841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271bf3d-454a-4a67-b190-b41699bc3402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:19.392110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271bf3d-454a-4a67-b190-b41699bc3402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:19.393739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b271bf3d-454a-4a67-b190-b41699bc3402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:19.500238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271bf3d-454a-4a67-b190-b41699bc3402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:19.501654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271bf3d-454a-4a67-b190-b41699bc3402 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:19.519395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 731/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:21.544995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93227d-9cf2-44ac-873a-720e93100667 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:21.545533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93227d-9cf2-44ac-873a-720e93100667 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:21.545533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93227d-9cf2-44ac-873a-720e93100667 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:21.546886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:21.552153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975b6e-5f75-46dd-a52a-c27ac720dbcd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:21.552567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975b6e-5f75-46dd-a52a-c27ac720dbcd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:21.552721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975b6e-5f75-46dd-a52a-c27ac720dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:21.622623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ea975b6e-5f75-46dd-a52a-c27ac720dbcd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:21.623830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ea975b6e-5f75-46dd-a52a-c27ac720dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:21.632241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:21.719654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:21.757489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93227d-9cf2-44ac-873a-720e93100667 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:21.759079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cc93227d-9cf2-44ac-873a-720e93100667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:21.861698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93227d-9cf2-44ac-873a-720e93100667 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:21.917760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:21.937022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3f71-16ac-4e75-88fe-2c94228202ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:21.937641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3f71-16ac-4e75-88fe-2c94228202ee service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:21.937923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3f71-16ac-4e75-88fe-2c94228202ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:21.938196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3f71-16ac-4e75-88fe-2c94228202ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:21.939867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e00a3f71-16ac-4e75-88fe-2c94228202ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:22.060557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a3f71-16ac-4e75-88fe-2c94228202ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:22.062010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a3f71-16ac-4e75-88fe-2c94228202ee service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:22.079587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 729/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:24.110638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd949-d1b4-4c8a-a541-7ceb5463fa74 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:24.111206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd949-d1b4-4c8a-a541-7ceb5463fa74 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:24.111206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efd949-d1b4-4c8a-a541-7ceb5463fa74 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:24.112516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:24.117788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e7cc5-a1cc-4e0d-9314-b0e4a116e881 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:24.118174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e7cc5-a1cc-4e0d-9314-b0e4a116e881 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:24.118372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e7cc5-a1cc-4e0d-9314-b0e4a116e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:24.183909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-cb2e7cc5-a1cc-4e0d-9314-b0e4a116e881 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:24.185097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cb2e7cc5-a1cc-4e0d-9314-b0e4a116e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:24.223048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:24.281920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:24.318743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efd949-d1b4-4c8a-a541-7ceb5463fa74 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:24.320262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b4efd949-d1b4-4c8a-a541-7ceb5463fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:24.420915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efd949-d1b4-4c8a-a541-7ceb5463fa74 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:24.458431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:24.493257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b044f9-1b4c-4592-a114-8e74c19eb531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:24.493875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b044f9-1b4c-4592-a114-8e74c19eb531 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:24.494173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b044f9-1b4c-4592-a114-8e74c19eb531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:24.494584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b044f9-1b4c-4592-a114-8e74c19eb531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:24.496720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-38b044f9-1b4c-4592-a114-8e74c19eb531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:24.603342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b044f9-1b4c-4592-a114-8e74c19eb531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:24.604761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b044f9-1b4c-4592-a114-8e74c19eb531 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:24.622775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 734/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:26.654596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59556-1653-427f-8539-4990d552c415 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:26.655168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59556-1653-427f-8539-4990d552c415 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:26.655168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59556-1653-427f-8539-4990d552c415 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:26.656486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:26.662449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b71773-dd64-4c42-a9e3-4d15dad7b2c3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:26.662911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b71773-dd64-4c42-a9e3-4d15dad7b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:26.663020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b71773-dd64-4c42-a9e3-4d15dad7b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:26.727903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-75b71773-dd64-4c42-a9e3-4d15dad7b2c3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:26.729099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-75b71773-dd64-4c42-a9e3-4d15dad7b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:26.747112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:26.824932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:09:26.861332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59556-1653-427f-8539-4990d552c415 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:26.862938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0ed59556-1653-427f-8539-4990d552c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:26.964205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59556-1653-427f-8539-4990d552c415 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:27.029812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:27.036674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036f944-8fda-458b-bb83-0c122a722432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:27.037295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f944-8fda-458b-bb83-0c122a722432 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:27.037577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f944-8fda-458b-bb83-0c122a722432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:27.037846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036f944-8fda-458b-bb83-0c122a722432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:27.039502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f036f944-8fda-458b-bb83-0c122a722432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:27.147597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036f944-8fda-458b-bb83-0c122a722432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:27.149035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036f944-8fda-458b-bb83-0c122a722432 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:27.167135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 732/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:09:29.160848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150b0b6-6b1d-45d9-8ab8-258de8748f7f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:29.161356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150b0b6-6b1d-45d9-8ab8-258de8748f7f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:29.161454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150b0b6-6b1d-45d9-8ab8-258de8748f7f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:29.162801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:29.168118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ef808-86a8-4a1c-9067-fa436c6b5e41 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:29.168577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ef808-86a8-4a1c-9067-fa436c6b5e41 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:29.168676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ef808-86a8-4a1c-9067-fa436c6b5e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:29.233416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7a9ef808-86a8-4a1c-9067-fa436c6b5e41 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:29.234645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7a9ef808-86a8-4a1c-9067-fa436c6b5e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:29.282205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:29.330463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:29.366772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150b0b6-6b1d-45d9-8ab8-258de8748f7f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:29.368303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3150b0b6-6b1d-45d9-8ab8-258de8748f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:29.471394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150b0b6-6b1d-45d9-8ab8-258de8748f7f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:29.517711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:29.544768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3552689-bae6-46c6-995c-8ef3fc129dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:29.545386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3552689-bae6-46c6-995c-8ef3fc129dff service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:29.545666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3552689-bae6-46c6-995c-8ef3fc129dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:29.545941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3552689-bae6-46c6-995c-8ef3fc129dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:29.547638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f3552689-bae6-46c6-995c-8ef3fc129dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:29.654883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3552689-bae6-46c6-995c-8ef3fc129dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:29.656319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3552689-bae6-46c6-995c-8ef3fc129dff service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:29.673772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 737/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:39.328562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=22 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:39.671573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=66 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:49.072473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8b0d-d5c6-4753-94d7-f6c287f8e5cd None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:49.073070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8b0d-d5c6-4753-94d7-f6c287f8e5cd None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:49.073070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8b0d-d5c6-4753-94d7-f6c287f8e5cd None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:49.074413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 734/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:49.079887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212397-311e-4f24-975b-579d02d6ce78 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:49.080309 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212397-311e-4f24-975b-579d02d6ce78 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:49.080460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212397-311e-4f24-975b-579d02d6ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:49.152144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1f212397-311e-4f24-975b-579d02d6ce78 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:49.153353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1f212397-311e-4f24-975b-579d02d6ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:49.247858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 738/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:49.330871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896c11c-bf9c-4496-a723-4745811181a6 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:49.331179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896c11c-bf9c-4496-a723-4745811181a6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:49.331461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896c11c-bf9c-4496-a723-4745811181a6 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:49.332914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 735/1473] 10.222.0.48 () {54 vars in 966 bytes} [Thu Jul 28 22:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:49.337566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddf54-ad96-444f-8776-e4bf0ecbc46c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:49.337849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddf54-ad96-444f-8776-e4bf0ecbc46c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:49.338120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdddf54-ad96-444f-8776-e4bf0ecbc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:49.414435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bbdddf54-ad96-444f-8776-e4bf0ecbc46c None None] MFA Rules not processed for user `a2718132c4914dbda4582e259eccbaef`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:49.415632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bbdddf54-ad96-444f-8776-e4bf0ecbc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:49.436651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:49.496885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 739/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Thu Jul 28 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:49.504517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896c11c-bf9c-4496-a723-4745811181a6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:49.506336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e896c11c-bf9c-4496-a723-4745811181a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:49.609161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896c11c-bf9c-4496-a723-4745811181a6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:49.681427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff99a5f-0d6e-4468-8d22-bb651ce8efdf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:49.682044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff99a5f-0d6e-4468-8d22-bb651ce8efdf service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:49.682353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff99a5f-0d6e-4468-8d22-bb651ce8efdf service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:49.682627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff99a5f-0d6e-4468-8d22-bb651ce8efdf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:49.684238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fff99a5f-0d6e-4468-8d22-bb651ce8efdf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:49.736964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:49.791637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff99a5f-0d6e-4468-8d22-bb651ce8efdf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:49.793055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff99a5f-0d6e-4468-8d22-bb651ce8efdf service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:49.812545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 736/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:51.900362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5111b-4126-49bb-8b9e-496d00f5b970 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:51.900943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5111b-4126-49bb-8b9e-496d00f5b970 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:51.900943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5111b-4126-49bb-8b9e-496d00f5b970 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:51.902336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 740/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:51.907453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53501-bf5d-437d-9a88-dbf5273dd6c5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:51.907914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53501-bf5d-437d-9a88-dbf5273dd6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:51.908011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53501-bf5d-437d-9a88-dbf5273dd6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:51.973273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-23d53501-bf5d-437d-9a88-dbf5273dd6c5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:51.974515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-23d53501-bf5d-437d-9a88-dbf5273dd6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:52.070817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 737/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:52.094934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5111b-4126-49bb-8b9e-496d00f5b970 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:52.096552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3ee5111b-4126-49bb-8b9e-496d00f5b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:52.221128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5111b-4126-49bb-8b9e-496d00f5b970 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:52.270657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:52.315597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426afd87-10ff-42a0-aaf9-e8281b736675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:52.316207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afd87-10ff-42a0-aaf9-e8281b736675 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:52.316484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afd87-10ff-42a0-aaf9-e8281b736675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:52.316751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afd87-10ff-42a0-aaf9-e8281b736675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:52.317443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426afd87-10ff-42a0-aaf9-e8281b736675 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:52.319192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-426afd87-10ff-42a0-aaf9-e8281b736675 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:09:52.319192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:09:52.319192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:09:52.320317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426afd87-10ff-42a0-aaf9-e8281b736675 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:52.340011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 741/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 28 22:09:52 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:09:54.359999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d407b-fbbb-4b56-9db9-13ecd5fa7849 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:54.360548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d407b-fbbb-4b56-9db9-13ecd5fa7849 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:54.360548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d407b-fbbb-4b56-9db9-13ecd5fa7849 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:54.361886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 738/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:54.367081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307916-d1d2-4b4e-ad50-249f32148cdd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:54.367566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307916-d1d2-4b4e-ad50-249f32148cdd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:54.367663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307916-d1d2-4b4e-ad50-249f32148cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:54.433823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c5307916-d1d2-4b4e-ad50-249f32148cdd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:54.434996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c5307916-d1d2-4b4e-ad50-249f32148cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:54.530618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 742/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:54.572349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d407b-fbbb-4b56-9db9-13ecd5fa7849 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:54.574572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7c8d407b-fbbb-4b56-9db9-13ecd5fa7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:54.584385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:54.718182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d407b-fbbb-4b56-9db9-13ecd5fa7849 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:54.798202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:54.831916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c24a-016f-4502-94ae-91ad55520854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:54.832543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c24a-016f-4502-94ae-91ad55520854 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:54.832824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c24a-016f-4502-94ae-91ad55520854 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:54.833101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c24a-016f-4502-94ae-91ad55520854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:54.834773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0fd6c24a-016f-4502-94ae-91ad55520854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:54.922725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6c24a-016f-4502-94ae-91ad55520854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:54.924314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6c24a-016f-4502-94ae-91ad55520854 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:54.942871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 739/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:57.126376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01cc0-8a05-4e5a-b320-3ffd6e6091d2 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:57.126940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01cc0-8a05-4e5a-b320-3ffd6e6091d2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:57.126940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01cc0-8a05-4e5a-b320-3ffd6e6091d2 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:57.128317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 743/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:57.133771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f84c7a-5615-4fbd-a984-f8a6955bfbb0 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:57.134169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f84c7a-5615-4fbd-a984-f8a6955bfbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:57.134412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f84c7a-5615-4fbd-a984-f8a6955bfbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:57.200405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f5f84c7a-5615-4fbd-a984-f8a6955bfbb0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:57.201598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f5f84c7a-5615-4fbd-a984-f8a6955bfbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:57.247427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:57.298871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 740/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:09:57.334342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01cc0-8a05-4e5a-b320-3ffd6e6091d2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:57.335880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e3a01cc0-8a05-4e5a-b320-3ffd6e6091d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:57.359828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:57.441544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01cc0-8a05-4e5a-b320-3ffd6e6091d2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:09:57.516675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629a04-6467-4eda-bdf6-621d6274422e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:09:57.517287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629a04-6467-4eda-bdf6-621d6274422e service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:57.517562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629a04-6467-4eda-bdf6-621d6274422e service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:57.517826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629a04-6467-4eda-bdf6-621d6274422e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:57.519503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-12629a04-6467-4eda-bdf6-621d6274422e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:57.591977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:09:57.626473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12629a04-6467-4eda-bdf6-621d6274422e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:09:57.627891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12629a04-6467-4eda-bdf6-621d6274422e service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:09:57.646072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 744/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:09:59.679698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660b4d4-82ce-4c74-ac03-889b613a2a01 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:59.680284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660b4d4-82ce-4c74-ac03-889b613a2a01 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:59.680284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660b4d4-82ce-4c74-ac03-889b613a2a01 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:59.681585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 741/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:09:59.687575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f39e7-1865-4269-a65d-3a072160879a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:09:59.687984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f39e7-1865-4269-a65d-3a072160879a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:09:59.688166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f39e7-1865-4269-a65d-3a072160879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:09:59.752680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-155f39e7-1865-4269-a65d-3a072160879a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:09:59.753903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-155f39e7-1865-4269-a65d-3a072160879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:59.850481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 745/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:09:59.889357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660b4d4-82ce-4c74-ac03-889b613a2a01 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:09:59.890941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f660b4d4-82ce-4c74-ac03-889b613a2a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:09:59.992338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660b4d4-82ce-4c74-ac03-889b613a2a01 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:10:00.064010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:10:00.066033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a0feb-f439-478d-b444-c2dda19821c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:10:00.066753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0feb-f439-478d-b444-c2dda19821c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:10:00.067213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0feb-f439-478d-b444-c2dda19821c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:10:00.067698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0feb-f439-478d-b444-c2dda19821c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:10:00.069584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0e2a0feb-f439-478d-b444-c2dda19821c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:10:00.180301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a0feb-f439-478d-b444-c2dda19821c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:10:00.181838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a0feb-f439-478d-b444-c2dda19821c4 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:10:00.200094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 742/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:10:02.282297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7f9aa-2734-4737-bb21-5d56fe25f3e6 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:10:02.282763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7f9aa-2734-4737-bb21-5d56fe25f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:10:02.282875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7f9aa-2734-4737-bb21-5d56fe25f3e6 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:10:02.284266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 746/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:10:02.289329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb0e30-b263-47f7-846c-ef8abc387555 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:10:02.289758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb0e30-b263-47f7-846c-ef8abc387555 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:10:02.289884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb0e30-b263-47f7-846c-ef8abc387555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:10:02.355032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bedb0e30-b263-47f7-846c-ef8abc387555 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:10:02.356226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bedb0e30-b263-47f7-846c-ef8abc387555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:10:02.409404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:10:02.572259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 743/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:10:02.613506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7f9aa-2734-4737-bb21-5d56fe25f3e6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:10:02.615092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b9b7f9aa-2734-4737-bb21-5d56fe25f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:10:02.652049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:10:02.718922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7f9aa-2734-4737-bb21-5d56fe25f3e6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:10:02.790342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c9d37-69aa-43c9-833d-2f04783bbc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:10:02.790956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9d37-69aa-43c9-833d-2f04783bbc08 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:10:02.791280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9d37-69aa-43c9-833d-2f04783bbc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:10:02.792053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c9d37-69aa-43c9-833d-2f04783bbc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:10:02.793697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-467c9d37-69aa-43c9-833d-2f04783bbc08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:10:02.872409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:10:02.902481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c9d37-69aa-43c9-833d-2f04783bbc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:10:02.903905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c9d37-69aa-43c9-833d-2f04783bbc08 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:10:02.921369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 747/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:10:05.347632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4dca-861e-4f7c-8b5e-716bffca0b47 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:10:05.348133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4dca-861e-4f7c-8b5e-716bffca0b47 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:10:05.348249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4dca-861e-4f7c-8b5e-716bffca0b47 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:10:05.349513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 744/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 28 22:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:10:05.355354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c458-7101-4b1c-bc83-24ce3b8f99b3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:10:05.355762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c458-7101-4b1c-bc83-24ce3b8f99b3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:10:05.355894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c458-7101-4b1c-bc83-24ce3b8f99b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:10:05.420575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7ed1c458-7101-4b1c-bc83-24ce3b8f99b3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:10:05.421671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7ed1c458-7101-4b1c-bc83-24ce3b8f99b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:10:05.516265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 748/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 28 22:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:10:05.558277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4dca-861e-4f7c-8b5e-716bffca0b47 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:10:05.559813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b1fa4dca-861e-4f7c-8b5e-716bffca0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:10:05.661986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4dca-861e-4f7c-8b5e-716bffca0b47 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:10:05.736749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f7831-799d-4cc8-a4ae-ac5b16416647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:10:05.737295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7831-799d-4cc8-a4ae-ac5b16416647 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:10:05.737572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7831-799d-4cc8-a4ae-ac5b16416647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:10:05.737842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7831-799d-4cc8-a4ae-ac5b16416647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:10:05.739491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-806f7831-799d-4cc8-a4ae-ac5b16416647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:10:05.747985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:10:05.852248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f7831-799d-4cc8-a4ae-ac5b16416647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:10:05.853791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f7831-799d-4cc8-a4ae-ac5b16416647 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:10:05.874240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 745/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:10:15.514531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=82 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:10:15.871932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=50 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:00.039359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:00.039969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:00.039969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:00.116064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:12:00.117278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:00.214547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 749/1494] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:12:00.222607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8dc5-4504-4522-9aeb-2f5399a2a343 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:00.223120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8dc5-4504-4522-9aeb-2f5399a2a343 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:00.223234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8dc5-4504-4522-9aeb-2f5399a2a343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:00.296655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-551e8dc5-4504-4522-9aeb-2f5399a2a343 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:12:00.297793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-551e8dc5-4504-4522-9aeb-2f5399a2a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:00.395583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 746/1495] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:12:00.400368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:00.401581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:00.412958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793fc3-e416-4e68-822d-719df84a8956 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:00.474613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:00.508126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:00.508754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:00.509031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:00.509316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:00.509978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:12:00.510303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:00.511333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:00.511333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:12:00.511333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:12:00.512207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:00.523753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 750/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:12:00.532040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8dc5-4504-4522-9aeb-2f5399a2a343 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:00.541174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8dc5-4504-4522-9aeb-2f5399a2a343 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:00.602100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:00.635882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:00.636497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:00.636770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:00.637035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:00.637691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:00.639506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING py.warnings [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:00.639506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: warnings.warn(msg) Jul 28 22:12:00.639506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: Jul 28 22:12:00.640682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:00.695373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 747/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:12:00 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:12:00.699520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:00.701030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:00.733379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c0205-5fe2-4a56-9c56-a7df92346104 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:00.824610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:00.825222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:00.825504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:00.825776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:00.826465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:00.827507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:00.827507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:12:00.827507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:12:00.828709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:00.870842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 751/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:12:00 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:12:00.875608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:00.877169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:00.940838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613bc1-54c0-417b-8d36-df87de2eaf42 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:01.022718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:01.034310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:01.034918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:01.035192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:01.035458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:01.036143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:01.037147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING py.warnings [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:01.037147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: warnings.warn(msg) Jul 28 22:12:01.037147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: Jul 28 22:12:01.038014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:01.050714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 748/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:12:01.054683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:01.056191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:01.067369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a78be1-693f-4a26-91f3-9440b08a359a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:01.092749 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:01.162893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd5bbb-6c13-4133-b921-16c10b658b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:01.163512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5bbb-6c13-4133-b921-16c10b658b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:01.163791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5bbb-6c13-4133-b921-16c10b658b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:01.164058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5bbb-6c13-4133-b921-16c10b658b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:01.164743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd5bbb-6c13-4133-b921-16c10b658b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:01.165753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-0ebd5bbb-6c13-4133-b921-16c10b658b8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:01.165753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:12:01.165753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:12:01.166668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd5bbb-6c13-4133-b921-16c10b658b8e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:01.179343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 752/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:12:01.183577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:01.185130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:01.217691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c435a-4696-4c1a-8b5c-47664ca742ca admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:01.309943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbbbf4-5ddd-4710-a4b0-84b3a1edcbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:01.310638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbbbf4-5ddd-4710-a4b0-84b3a1edcbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:01.310916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbbbf4-5ddd-4710-a4b0-84b3a1edcbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:01.311189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbbbf4-5ddd-4710-a4b0-84b3a1edcbbf admin admin] PATH_INFO: `/v3/projects/51c9f425d384492c902f5dcaf212013d/users/136ac2d073ab4dc19e669dada70be977/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:01.332796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbbbf4-5ddd-4710-a4b0-84b3a1edcbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c9f425d384492c902f5dcaf212013d, user_id=136ac2d073ab4dc19e669dada70be977, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:01.333815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING py.warnings [None req-3bbbbbf4-5ddd-4710-a4b0-84b3a1edcbbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:01.333815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: warnings.warn(msg) Jul 28 22:12:01.333815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: Jul 28 22:12:01.335778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbbbf4-5ddd-4710-a4b0-84b3a1edcbbf admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:01.364080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 749/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:12:01 2022] PUT /identity/v3/projects/51c9f425d384492c902f5dcaf212013d/users/136ac2d073ab4dc19e669dada70be977/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:12:01.376210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef893b-47ef-493f-8704-3cbc3bf7d7e2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:01.376499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef893b-47ef-493f-8704-3cbc3bf7d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:01.376776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef893b-47ef-493f-8704-3cbc3bf7d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:01.434629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5bef893b-47ef-493f-8704-3cbc3bf7d7e2 None None] MFA Rules not processed for user `136ac2d073ab4dc19e669dada70be977`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:12:01.435763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5bef893b-47ef-493f-8704-3cbc3bf7d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:01.510779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 753/1502] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:12:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:12:01.524555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225bb42-4a96-4c1d-8221-d6a684136536 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:01.524840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225bb42-4a96-4c1d-8221-d6a684136536 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:01.525110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225bb42-4a96-4c1d-8221-d6a684136536 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:01.526505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 750/1503] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jul 28 22:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:12:01.532001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864a845-2048-4ce0-9208-c12d3280fcc1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:01.532283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864a845-2048-4ce0-9208-c12d3280fcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:01.532556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864a845-2048-4ce0-9208-c12d3280fcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:01.562957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:01.610086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b864a845-2048-4ce0-9208-c12d3280fcc1 None None] MFA Rules not processed for user `fccb9c8b7ba54808ab77499297173498`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:12:01.611324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b864a845-2048-4ce0-9208-c12d3280fcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:01.684464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 754/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jul 28 22:12:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:12:01.692714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225bb42-4a96-4c1d-8221-d6a684136536 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:01.694128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1225bb42-4a96-4c1d-8221-d6a684136536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:01.750906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:01.811767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225bb42-4a96-4c1d-8221-d6a684136536 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:01.884894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:01.885504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:01.885781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:01.886046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:01.887817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:01.984608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:01.985966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:01.989430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:02.004036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 751/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:12:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:12:02.049897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9f552-1722-409b-b458-0b93ac12cdf3 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:02.050179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9f552-1722-409b-b458-0b93ac12cdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:02.050478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9f552-1722-409b-b458-0b93ac12cdf3 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:02.051737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 755/1506] 10.222.0.48 () {52 vars in 830 bytes} [Thu Jul 28 22:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:12:02.055381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:02.056591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:02.156799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e84074-bf10-42a9-b98e-040379ae5008 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:02.249867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:02.250455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:02.250735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:02.251002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] PATH_INFO: `/v3/users/136ac2d073ab4dc19e669dada70be977` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:02.263133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136ac2d073ab4dc19e669dada70be977)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:02.264151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING py.warnings [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:02.264151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: warnings.warn(msg) Jul 28 22:12:02.264151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: Jul 28 22:12:02.265355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:02.274716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:02.327981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136ac2d073ab4dc19e669dada70be977'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:02.328506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136ac2d073ab4dc19e669dada70be977'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:02.340900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136ac2d073ab4dc19e669dada70be977'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:02.341383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136ac2d073ab4dc19e669dada70be977'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:02.359422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136ac2d073ab4dc19e669dada70be977'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:02.374464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 752/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:12:02 2022] DELETE /identity/v3/users/136ac2d073ab4dc19e669dada70be977 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:12:02.378907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:02.379400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:02.379510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:02.435914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:12:02.437111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:02.510819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:02.523508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 756/1508] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:12:02.533604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:02.534899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:02.635845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c7636-d7d2-40b5-abe7-ad7c93d08747 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:02.689729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:02.709572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9e3c-3db0-48d9-91e3-9367865e1930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:02.710188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9e3c-3db0-48d9-91e3-9367865e1930 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:02.710496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9e3c-3db0-48d9-91e3-9367865e1930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:02.710772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9e3c-3db0-48d9-91e3-9367865e1930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:02.712390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-45ef9e3c-3db0-48d9-91e3-9367865e1930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:02.818669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9e3c-3db0-48d9-91e3-9367865e1930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:02.820041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9e3c-3db0-48d9-91e3-9367865e1930 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:02.839013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 753/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:12:03.193448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:12:03.194713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:12:03.206561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c03dba-39d6-42df-9685-469e8a9ada1b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:12:03.302896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:12:03.303534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:12:03.303808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:12:03.304075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] PATH_INFO: `/v3/projects/51c9f425d384492c902f5dcaf212013d` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:12:03.314375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c9f425d384492c902f5dcaf212013d)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:12:03.315397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:12:03.315397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:12:03.315397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:12:03.316583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:12:03.376649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c9f425d384492c902f5dcaf212013d', 'request_id': 'req-b61a3aae-f244-4af8-9dbf-dd3cb8134706'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:03.386072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c9f425d384492c902f5dcaf212013d', 'request_id': 'req-b61a3aae-f244-4af8-9dbf-dd3cb8134706'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:03.392823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c9f425d384492c902f5dcaf212013d', 'request_id': 'req-b61a3aae-f244-4af8-9dbf-dd3cb8134706'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:03.421842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] The token cache is being invalidate because project 51c9f425d384492c902f5dcaf212013d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:12:03.422129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:03.422586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b61a3aae-f244-4af8-9dbf-dd3cb8134706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:12:03.424012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 757/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:12:03 2022] DELETE /identity/v3/projects/51c9f425d384492c902f5dcaf212013d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:12:12.836696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=62 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:12:13.419955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:13:49.059157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503cdb4-1c37-4059-b05e-77d679903a58 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:49.059767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503cdb4-1c37-4059-b05e-77d679903a58 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:49.059767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503cdb4-1c37-4059-b05e-77d679903a58 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:49.061098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:13:49.066644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dad0b-52c6-4ce3-af08-961d8b8f25d9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:49.067095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dad0b-52c6-4ce3-af08-961d8b8f25d9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:49.067200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dad0b-52c6-4ce3-af08-961d8b8f25d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:49.148805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f28dad0b-52c6-4ce3-af08-961d8b8f25d9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:13:49.150314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f28dad0b-52c6-4ce3-af08-961d8b8f25d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:13:49.253013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:13:49.404612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503cdb4-1c37-4059-b05e-77d679903a58 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:13:49.406779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f503cdb4-1c37-4059-b05e-77d679903a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:13:49.527137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503cdb4-1c37-4059-b05e-77d679903a58 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:13:49.533174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b469ab-5b81-483d-812f-1ef5990fdce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:13:49.533786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b469ab-5b81-483d-812f-1ef5990fdce4 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:49.534065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b469ab-5b81-483d-812f-1ef5990fdce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:49.534380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b469ab-5b81-483d-812f-1ef5990fdce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:49.542362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b469ab-5b81-483d-812f-1ef5990fdce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:13:49.543932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b469ab-5b81-483d-812f-1ef5990fdce4 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:13:49.554607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 755/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:13:50.378714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08cdba-41d5-4a01-b374-dad8cb875bfb None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:50.378714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08cdba-41d5-4a01-b374-dad8cb875bfb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:50.379193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08cdba-41d5-4a01-b374-dad8cb875bfb None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:50.380366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:13:50.385401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d9cd-b351-4ea8-8d60-eae9e6ba7a32 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:50.385810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d9cd-b351-4ea8-8d60-eae9e6ba7a32 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:50.385957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d9cd-b351-4ea8-8d60-eae9e6ba7a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:50.405721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-b4b3d9cd-b351-4ea8-8d60-eae9e6ba7a32 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:13:50.406957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b4b3d9cd-b351-4ea8-8d60-eae9e6ba7a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:13:50.415065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:13:50.569105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08cdba-41d5-4a01-b374-dad8cb875bfb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:13:50.583924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08cdba-41d5-4a01-b374-dad8cb875bfb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:13:50.589319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63988ad-b933-481c-bd2a-21432db7447f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:13:50.589923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63988ad-b933-481c-bd2a-21432db7447f service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:50.590202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63988ad-b933-481c-bd2a-21432db7447f service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:50.590501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63988ad-b933-481c-bd2a-21432db7447f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:50.598528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63988ad-b933-481c-bd2a-21432db7447f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:13:50.600118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63988ad-b933-481c-bd2a-21432db7447f service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:13:50.609372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 760/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:13:51.048445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e6b5-035b-4a1d-897e-f3cf330aeb7d None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:51.048659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e6b5-035b-4a1d-897e-f3cf330aeb7d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:51.048924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e6b5-035b-4a1d-897e-f3cf330aeb7d None None] PATH_INFO: `/v3` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:51.050197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 757/1517] 10.222.0.42 () {54 vars in 925 bytes} [Thu Jul 28 22:13:51 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:13:51.056288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144941-c047-4200-ab65-f1736328bd43 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:13:51.056602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144941-c047-4200-ab65-f1736328bd43 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:13:51.056879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144941-c047-4200-ab65-f1736328bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:13:51.115335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1e144941-c047-4200-ab65-f1736328bd43 None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:13:51.116535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1e144941-c047-4200-ab65-f1736328bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:13:51.132976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:13:51.187445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 761/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jul 28 22:13:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:00.400851 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=56 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:14:00.628342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead02e-4d74-492f-9f53-c4378dfc9bed None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:00.628624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead02e-4d74-492f-9f53-c4378dfc9bed None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:00.628902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ead02e-4d74-492f-9f53-c4378dfc9bed None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:00.630311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 758/1519] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jul 28 22:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:14:00.635404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b43124-0a6f-429e-94f7-3183071f7dbf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:00.635864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b43124-0a6f-429e-94f7-3183071f7dbf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:00.636012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b43124-0a6f-429e-94f7-3183071f7dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:00.656895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-00b43124-0a6f-429e-94f7-3183071f7dbf None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:14:00.658073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-00b43124-0a6f-429e-94f7-3183071f7dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:00.666458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 762/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jul 28 22:14:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:00.674304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ead02e-4d74-492f-9f53-c4378dfc9bed None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:14:00.688188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ead02e-4d74-492f-9f53-c4378dfc9bed None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:14:00.693182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92953660-9cdd-44ef-8686-38bb7468d718 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:14:00.693781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953660-9cdd-44ef-8686-38bb7468d718 service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:00.694063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953660-9cdd-44ef-8686-38bb7468d718 service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:00.694370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953660-9cdd-44ef-8686-38bb7468d718 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:00.702527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92953660-9cdd-44ef-8686-38bb7468d718 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:14:00.704110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92953660-9cdd-44ef-8686-38bb7468d718 service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:14:00.713601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 759/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:14:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:14:01.842182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7468b-4c70-4040-8c8e-cfd8b8178c3f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:01.842809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7468b-4c70-4040-8c8e-cfd8b8178c3f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:01.842809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7468b-4c70-4040-8c8e-cfd8b8178c3f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:01.844278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:14:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:14:01.849446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23472-6c55-4f25-9829-4f78fb43865e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:01.849875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23472-6c55-4f25-9829-4f78fb43865e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:01.849971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a23472-6c55-4f25-9829-4f78fb43865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:01.869213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-13a23472-6c55-4f25-9829-4f78fb43865e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:14:01.870494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-13a23472-6c55-4f25-9829-4f78fb43865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:01.878814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:02.030627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7468b-4c70-4040-8c8e-cfd8b8178c3f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:14:02.044619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7468b-4c70-4040-8c8e-cfd8b8178c3f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:14:02.050467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7517229-0ccc-4454-8b18-2c264223f450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:14:02.051068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7517229-0ccc-4454-8b18-2c264223f450 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:02.051346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7517229-0ccc-4454-8b18-2c264223f450 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:02.051616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7517229-0ccc-4454-8b18-2c264223f450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:02.059489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7517229-0ccc-4454-8b18-2c264223f450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:14:02.061040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7517229-0ccc-4454-8b18-2c264223f450 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:14:02.070741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 764/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:14:02.878322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d9a5f-33a7-4a5e-9fab-c694118c041b None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:02.878906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d9a5f-33a7-4a5e-9fab-c694118c041b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:02.878906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d9a5f-33a7-4a5e-9fab-c694118c041b None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:02.880206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 22:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:14:02.885303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85269d-c101-4b9e-a40e-cd08fa69ceed None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:02.885693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85269d-c101-4b9e-a40e-cd08fa69ceed None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:02.885846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85269d-c101-4b9e-a40e-cd08fa69ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:02.905175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7e85269d-c101-4b9e-a40e-cd08fa69ceed None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:14:02.906964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7e85269d-c101-4b9e-a40e-cd08fa69ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:02.914755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 22:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:03.065373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d9a5f-33a7-4a5e-9fab-c694118c041b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:14:03.080119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d9a5f-33a7-4a5e-9fab-c694118c041b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:14:03.085730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d42df8-b573-478d-bb5c-14baa6888b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:14:03.086373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d42df8-b573-478d-bb5c-14baa6888b23 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:03.086652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d42df8-b573-478d-bb5c-14baa6888b23 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:03.086921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d42df8-b573-478d-bb5c-14baa6888b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:03.095042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d42df8-b573-478d-bb5c-14baa6888b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:14:03.096611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d42df8-b573-478d-bb5c-14baa6888b23 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:14:03.106103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 762/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:14:06.835081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b78fc2-f6a0-4f8c-b6f9-89a7cb551379 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:06.835573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b78fc2-f6a0-4f8c-b6f9-89a7cb551379 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:06.835669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b78fc2-f6a0-4f8c-b6f9-89a7cb551379 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:06.836958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:14:06.842224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892520ed-cae1-446d-8014-7e8df63c9319 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:06.842716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892520ed-cae1-446d-8014-7e8df63c9319 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:06.842959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892520ed-cae1-446d-8014-7e8df63c9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:06.863689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-892520ed-cae1-446d-8014-7e8df63c9319 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:14:06.864883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-892520ed-cae1-446d-8014-7e8df63c9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:06.873005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:06.945337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b78fc2-f6a0-4f8c-b6f9-89a7cb551379 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:14:06.947127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-23b78fc2-f6a0-4f8c-b6f9-89a7cb551379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:07.024442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b78fc2-f6a0-4f8c-b6f9-89a7cb551379 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:14:07.027973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58439381-7131-4357-8490-aa01f39b3958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:14:07.028580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58439381-7131-4357-8490-aa01f39b3958 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:07.028854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58439381-7131-4357-8490-aa01f39b3958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:07.029121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58439381-7131-4357-8490-aa01f39b3958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:07.038354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58439381-7131-4357-8490-aa01f39b3958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:14:07.039767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58439381-7131-4357-8490-aa01f39b3958 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:14:07.049477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 767/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:14:09.029927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c866-4a94-4885-adc6-27c527469468 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:09.030533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c866-4a94-4885-adc6-27c527469468 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:09.030533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c866-4a94-4885-adc6-27c527469468 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:09.032390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:14:09.037574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534287b-ba8e-41b0-8075-03c5d261ca32 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:09.038026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534287b-ba8e-41b0-8075-03c5d261ca32 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:09.038126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534287b-ba8e-41b0-8075-03c5d261ca32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:09.057683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6534287b-ba8e-41b0-8075-03c5d261ca32 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:14:09.058894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6534287b-ba8e-41b0-8075-03c5d261ca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:09.066673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:09.103204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63c866-4a94-4885-adc6-27c527469468 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:14:09.105030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2f63c866-4a94-4885-adc6-27c527469468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:09.118598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63c866-4a94-4885-adc6-27c527469468 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:14:09.122057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3719b4-ed8a-49c8-b032-0e96861609aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:14:09.122692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3719b4-ed8a-49c8-b032-0e96861609aa service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:09.122963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3719b4-ed8a-49c8-b032-0e96861609aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:09.123229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3719b4-ed8a-49c8-b032-0e96861609aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:09.132527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3719b4-ed8a-49c8-b032-0e96861609aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:14:09.133958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3719b4-ed8a-49c8-b032-0e96861609aa service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:14:09.143801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 765/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:14:12.596054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06be0-b253-4e78-8280-017425406426 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:12.596665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06be0-b253-4e78-8280-017425406426 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:12.596665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06be0-b253-4e78-8280-017425406426 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:12.598009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:14:12.603214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df316-bb6a-4e07-8a95-8c4216bce82a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:12.603644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df316-bb6a-4e07-8a95-8c4216bce82a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:12.603753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df316-bb6a-4e07-8a95-8c4216bce82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:12.622671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d79df316-bb6a-4e07-8a95-8c4216bce82a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:14:12.623856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d79df316-bb6a-4e07-8a95-8c4216bce82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:12.631921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:12.938130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b06be0-b253-4e78-8280-017425406426 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:14:12.939854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-91b06be0-b253-4e78-8280-017425406426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:13.002921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:14:13.017307 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b06be0-b253-4e78-8280-017425406426 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:14:13.020794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92372801-243f-42c9-a0df-1d74fd9c49fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:14:13.021402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372801-243f-42c9-a0df-1d74fd9c49fb service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:13.021790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372801-243f-42c9-a0df-1d74fd9c49fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:13.022061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372801-243f-42c9-a0df-1d74fd9c49fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:13.031922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92372801-243f-42c9-a0df-1d74fd9c49fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:14:13.033321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92372801-243f-42c9-a0df-1d74fd9c49fb service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:14:13.042403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 770/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:14:15.054276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628464a-c12e-440c-8ded-34648f7842c0 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:15.054843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628464a-c12e-440c-8ded-34648f7842c0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:15.054949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628464a-c12e-440c-8ded-34648f7842c0 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:15.056298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 22:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:14:15.061490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c67ee4-7be5-41c6-a9b2-39ed7844e89e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:15.061948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c67ee4-7be5-41c6-a9b2-39ed7844e89e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:15.062057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c67ee4-7be5-41c6-a9b2-39ed7844e89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:15.080921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b4c67ee4-7be5-41c6-a9b2-39ed7844e89e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:14:15.082099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b4c67ee4-7be5-41c6-a9b2-39ed7844e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:15.089957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 22:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:14:15.388167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628464a-c12e-440c-8ded-34648f7842c0 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:14:15.389860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7628464a-c12e-440c-8ded-34648f7842c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:14:15.403315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628464a-c12e-440c-8ded-34648f7842c0 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:14:15.407424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff37b-9ed9-403e-9312-0c641aa84ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:14:15.408080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff37b-9ed9-403e-9312-0c641aa84ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:14:15.408333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff37b-9ed9-403e-9312-0c641aa84ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:14:15.408603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff37b-9ed9-403e-9312-0c641aa84ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:14:15.417371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff37b-9ed9-403e-9312-0c641aa84ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:14:15.418828 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff37b-9ed9-403e-9312-0c641aa84ee3 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:14:15.428057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 768/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:14:25.076225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=11 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:14:25.424032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=33 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:49.663182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6503a84-a461-48b2-b675-8eab843eed33 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:49.664393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6503a84-a461-48b2-b675-8eab843eed33 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:49.664904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6503a84-a461-48b2-b675-8eab843eed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:49.691323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b6503a84-a461-48b2-b675-8eab843eed33 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:49.692737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b6503a84-a461-48b2-b675-8eab843eed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:49.701577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 772/1540] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:49.710583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73544b-5575-4ae7-85ad-196a138ca32e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:49.711159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73544b-5575-4ae7-85ad-196a138ca32e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:49.711159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73544b-5575-4ae7-85ad-196a138ca32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:49.739115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fc73544b-5575-4ae7-85ad-196a138ca32e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:49.740326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fc73544b-5575-4ae7-85ad-196a138ca32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:49.753066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 769/1541] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:49.758388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6503a84-a461-48b2-b675-8eab843eed33 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:49.778971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6503a84-a461-48b2-b675-8eab843eed33 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:49.790516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:49.791445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:49.791927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:49.792395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:49.793304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:49.793801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:49.797084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:49.813819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 773/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:49.822448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73544b-5575-4ae7-85ad-196a138ca32e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:49.832832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73544b-5575-4ae7-85ad-196a138ca32e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:49.843700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43720d-dd26-48f7-ad3f-6b488052f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:49.844329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43720d-dd26-48f7-ad3f-6b488052f4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:49.844603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43720d-dd26-48f7-ad3f-6b488052f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:49.844870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43720d-dd26-48f7-ad3f-6b488052f4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:49.849022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43720d-dd26-48f7-ad3f-6b488052f4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:49.849022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43720d-dd26-48f7-ad3f-6b488052f4b6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:49.906979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 770/1543] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:49 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:49.912297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:49.920456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da427ff-0058-499a-b80d-27ccc29256f1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:49.920456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da427ff-0058-499a-b80d-27ccc29256f1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:49.920456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da427ff-0058-499a-b80d-27ccc29256f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:49.927622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aea20-f202-4561-9192-e6a089068b05 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:49.951213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2da427ff-0058-499a-b80d-27ccc29256f1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:49.952445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2da427ff-0058-499a-b80d-27ccc29256f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.028191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ade1ec-3b35-4a88-a65f-f37c0b50cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.029784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ade1ec-3b35-4a88-a65f-f37c0b50cbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.030382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ade1ec-3b35-4a88-a65f-f37c0b50cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.030881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ade1ec-3b35-4a88-a65f-f37c0b50cbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.031779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ade1ec-3b35-4a88-a65f-f37c0b50cbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.033924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ade1ec-3b35-4a88-a65f-f37c0b50cbd8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.060513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 771/1544] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.070201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c345f-1615-42b3-abff-54f2189ee867 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.071838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c345f-1615-42b3-abff-54f2189ee867 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.072234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c345f-1615-42b3-abff-54f2189ee867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.078971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 774/1545] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:49 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.080433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd42543-41eb-4bfb-ad90-cc09191c79e0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.080723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd42543-41eb-4bfb-ad90-cc09191c79e0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.081013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd42543-41eb-4bfb-ad90-cc09191c79e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.106104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9bd42543-41eb-4bfb-ad90-cc09191c79e0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.107736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9bd42543-41eb-4bfb-ad90-cc09191c79e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.112435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f03c345f-1615-42b3-abff-54f2189ee867 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.113668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f03c345f-1615-42b3-abff-54f2189ee867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.116571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 775/1546] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.117615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435877-6ad8-4a32-851f-8cc97f80e6c4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.117894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435877-6ad8-4a32-851f-8cc97f80e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.118161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58435877-6ad8-4a32-851f-8cc97f80e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.122765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 772/1547] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.123838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49a859-4359-4bcb-9a31-b4a2c4fd0334 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.124127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49a859-4359-4bcb-9a31-b4a2c4fd0334 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.124397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49a859-4359-4bcb-9a31-b4a2c4fd0334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.138729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-58435877-6ad8-4a32-851f-8cc97f80e6c4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.139906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-58435877-6ad8-4a32-851f-8cc97f80e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.148564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 776/1548] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.149373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435877-6ad8-4a32-851f-8cc97f80e6c4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.154595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-0e49a859-4359-4bcb-9a31-b4a2c4fd0334 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.156042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0e49a859-4359-4bcb-9a31-b4a2c4fd0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.163464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58435877-6ad8-4a32-851f-8cc97f80e6c4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.165062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 773/1549] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.170529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d433b-b0f3-4d62-8025-2dd193f166fd None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.170529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d433b-b0f3-4d62-8025-2dd193f166fd None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.170529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d433b-b0f3-4d62-8025-2dd193f166fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.170779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e3736-be70-4bcf-8346-58d9d7da233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.170779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e3736-be70-4bcf-8346-58d9d7da233e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.170779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e3736-be70-4bcf-8346-58d9d7da233e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.170779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e3736-be70-4bcf-8346-58d9d7da233e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.171097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e3736-be70-4bcf-8346-58d9d7da233e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.171824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e3736-be70-4bcf-8346-58d9d7da233e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.182401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 777/1550] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:50.183724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803559-6f70-4137-823a-d4fcffccc49e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.184011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803559-6f70-4137-823a-d4fcffccc49e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.184281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803559-6f70-4137-823a-d4fcffccc49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.188574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-236d433b-b0f3-4d62-8025-2dd193f166fd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.189761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-236d433b-b0f3-4d62-8025-2dd193f166fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.198075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 774/1551] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.199296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd8bf1-615a-4bb9-b5ed-86c2c67ab8ad None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.199577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd8bf1-615a-4bb9-b5ed-86c2c67ab8ad None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.199848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd8bf1-615a-4bb9-b5ed-86c2c67ab8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.208715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e3803559-6f70-4137-823a-d4fcffccc49e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.210189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e3803559-6f70-4137-823a-d4fcffccc49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.219967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-0dcd8bf1-615a-4bb9-b5ed-86c2c67ab8ad None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.220127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 778/1552] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.221351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0dcd8bf1-615a-4bb9-b5ed-86c2c67ab8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.222049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b6aa-b3c5-409c-9e83-8ced4f64105f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.222637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b6aa-b3c5-409c-9e83-8ced4f64105f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.223121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b6aa-b3c5-409c-9e83-8ced4f64105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.236080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 775/1553] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.237498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5e70-5fe0-4667-b45d-861f6eaa1a70 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.237780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5e70-5fe0-4667-b45d-861f6eaa1a70 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.238047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5e70-5fe0-4667-b45d-861f6eaa1a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.246381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0419b6aa-b3c5-409c-9e83-8ced4f64105f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.248101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0419b6aa-b3c5-409c-9e83-8ced4f64105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.256050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 779/1554] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.257603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda395-52c9-4206-aee9-e4d0f710f6b7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.257888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda395-52c9-4206-aee9-e4d0f710f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.257978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-081f5e70-5fe0-4667-b45d-861f6eaa1a70 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.258162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddda395-52c9-4206-aee9-e4d0f710f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.259137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-081f5e70-5fe0-4667-b45d-861f6eaa1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.267721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 776/1555] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.268896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa025a-ca64-42fe-b9df-be70cabd96a3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.269172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa025a-ca64-42fe-b9df-be70cabd96a3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.269442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa025a-ca64-42fe-b9df-be70cabd96a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.278615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4ddda395-52c9-4206-aee9-e4d0f710f6b7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.279817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4ddda395-52c9-4206-aee9-e4d0f710f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.287713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bbaa025a-ca64-42fe-b9df-be70cabd96a3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.287858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 780/1556] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.288632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddda395-52c9-4206-aee9-e4d0f710f6b7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.288864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bbaa025a-ca64-42fe-b9df-be70cabd96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.297759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 777/1557] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.298118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddda395-52c9-4206-aee9-e4d0f710f6b7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.298410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa025a-ca64-42fe-b9df-be70cabd96a3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.304916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de75f64-17dd-4c7b-9ba7-7c26849ffe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.305521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75f64-17dd-4c7b-9ba7-7c26849ffe7e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.305798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75f64-17dd-4c7b-9ba7-7c26849ffe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.306066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75f64-17dd-4c7b-9ba7-7c26849ffe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.306794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de75f64-17dd-4c7b-9ba7-7c26849ffe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.307463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa025a-ca64-42fe-b9df-be70cabd96a3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.308378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de75f64-17dd-4c7b-9ba7-7c26849ffe7e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.312753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.313335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.313610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.313883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.314592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:50.314891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.315897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING py.warnings [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:15:50.315897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: warnings.warn(msg) Jul 28 22:15:50.315897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: Jul 28 22:15:50.316750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1320b-efea-417b-af5a-8a6e55155179 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.319221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 781/1558] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:50.320538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ed74-2fce-4d5a-8cc1-708b90902122 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.320812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ed74-2fce-4d5a-8cc1-708b90902122 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.321080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ed74-2fce-4d5a-8cc1-708b90902122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.333238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 778/1559] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:50.335420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240ae4-a272-49a7-9b2c-aca25a9085f2 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.335711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240ae4-a272-49a7-9b2c-aca25a9085f2 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.335985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240ae4-a272-49a7-9b2c-aca25a9085f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.348254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d8c2ed74-2fce-4d5a-8cc1-708b90902122 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.349582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d8c2ed74-2fce-4d5a-8cc1-708b90902122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.357511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-92240ae4-a272-49a7-9b2c-aca25a9085f2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.357873 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 782/1560] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.358876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-92240ae4-a272-49a7-9b2c-aca25a9085f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.359516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ed74-2fce-4d5a-8cc1-708b90902122 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.367364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 779/1561] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.368032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240ae4-a272-49a7-9b2c-aca25a9085f2 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.369679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ed74-2fce-4d5a-8cc1-708b90902122 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.375379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.376150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.376429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.376701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.377381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:50.377681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.377806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240ae4-a272-49a7-9b2c-aca25a9085f2 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.379323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.382680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.383266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.383571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.383816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.384497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:50.384798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.386396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.391531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 783/1562] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:50.392377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.401772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88079-9895-4e1b-b51a-18682942e196 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.410310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 780/1563] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:50.410506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.410621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.410727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.410727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.410727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.410727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:50.410727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.410727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.416491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f5869-b953-4bfd-b05e-f720718d61c1 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.421386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.422190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.422501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.422776 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.423471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:50.423767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 784/1564] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:50.423866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.424531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.425418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.436066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffff44-1a6d-403e-92ea-bd846987d706 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.438861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 781/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:50.440966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.441310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.441586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.441857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] PATH_INFO: `/v3/projects/0f0f84d89789430f8ed24e07ce5dcae9/users/c3b5516b045444cc959043157a4367ea/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.443334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.454606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f16fd6-0b62-4072-a3e8-ce264637c147 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.457249 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0f84d89789430f8ed24e07ce5dcae9, user_id=c3b5516b045444cc959043157a4367ea, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.458321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:15:50.458321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:15:50.458321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:15:50.459182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.459778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.460054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.460249 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.460347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.460959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.462868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.475181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 785/1566] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:50 2022] PUT /identity/v3/projects/0f0f84d89789430f8ed24e07ce5dcae9/users/c3b5516b045444cc959043157a4367ea/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:50.475878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.498830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 782/1567] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.499050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:50.500252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.519562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:50.540820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5fbd-655b-407e-803f-6a4e4a5de989 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.565784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abc5f-db26-4a90-90dc-9845fa53cd89 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.570523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.571141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.571416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.571684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.572372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:50.572676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.574278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.586600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 783/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:50.587195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.596818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.597462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.597739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.598007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.598382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c09fe2-0804-475c-8102-5deac78d224a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.598731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:15:50.599034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.600637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.602891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.603479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.603757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.604028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.604670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.607067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.619490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 786/1569] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:15:50.619490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.626085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354d6fd-bd05-4d7a-abae-07da51e29ae2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.631013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.631867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.632142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.632409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.633054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.634082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:15:50.634082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:15:50.634082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:15:50.635088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 784/1570] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.635305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.635951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.663859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 787/1571] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.664690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.703768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a655c-b058-4009-9eed-361a22cd4170 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.727783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915acfe0-a444-40fe-8a2e-06239c4593dc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.732928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a11c59-5c74-4086-8458-24e0dd71c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.733540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11c59-5c74-4086-8458-24e0dd71c5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.733819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11c59-5c74-4086-8458-24e0dd71c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.734091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a11c59-5c74-4086-8458-24e0dd71c5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.734773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11c59-5c74-4086-8458-24e0dd71c5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.736672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a11c59-5c74-4086-8458-24e0dd71c5ce admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.760865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.761614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.761837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.762105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.762817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.764700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.768046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 788/1572] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.769438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ae82-4851-4bfd-bd13-2863fbce4778 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.769732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ae82-4851-4bfd-bd13-2863fbce4778 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.770008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1ae82-4851-4bfd-bd13-2863fbce4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.788760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d8b1ae82-4851-4bfd-bd13-2863fbce4778 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:50.789985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d8b1ae82-4851-4bfd-bd13-2863fbce4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:50.797237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 785/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.797947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.811593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:50.821158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:50.855666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 789/1574] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:50.857240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ae82-4851-4bfd-bd13-2863fbce4778 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.863881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644ba7-466b-4051-807e-562a879d974e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.868577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.869198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.869482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.869752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1ae82-4851-4bfd-bd13-2863fbce4778 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.869867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.870473 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.871503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING py.warnings [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:15:50.871503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: warnings.warn(msg) Jul 28 22:15:50.871503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: Jul 28 22:15:50.873298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.875021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.875634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.875940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.876213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.876871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.878798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.894616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 786/1575] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.895394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.906449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e88bb-0a2f-403e-9e91-85a754435704 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:50.911718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 790/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.911718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.911997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:50.911997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:50.912178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:50.912693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:50.913091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:50.915028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:50.944867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 787/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:50.945501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:50.972289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23246132-ceea-4649-9019-3f1e3dd6856a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.007747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283302e-217a-4c80-b15d-f63528299a4b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.012370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.013014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.013295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.013566 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.014336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.016224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.030258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.030894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.031173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.031505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.032253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.034205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.037646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 788/1578] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:51.039088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.050348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccca1-e793-41ea-b4f3-bb9428d963ba admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.055887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.056651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 791/1579] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:50 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:51.056774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.056857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.057158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.057278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.057837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.060164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.067458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58c74f-fce1-4ff8-b5dd-e97021001262 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.072179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.072685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.073066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.073420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.074141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.076426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.081955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 789/1580] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:51 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:51.082855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.101588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 792/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:51 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:51.101588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.110772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c297a-58d5-46af-a01e-74b18edffc90 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.116331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.117051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.117455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.117736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.118461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.120079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.130705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 793/1582] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.132043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.142201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f89fd9-bb90-4619-89ac-a67e16aece5d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.143625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9f90-5a10-45e8-8406-4f168dfed0e8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.146805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.147251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.147411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.147692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.147859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.147955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.148138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.148436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.148659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.150583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.157914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.159379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.159785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:51.170061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 790/1583] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:51.170964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.176448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 794/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:51 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:51.176448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.176678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:51.185212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc991f6-a64d-40bd-a731-5ab87f9f6246 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.187146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f8f24-730c-43a0-9230-fb098879d1b0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.189999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.190649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.190928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.191194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.191847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.192681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.193352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.193707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.194017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.194207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.194899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.196596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.210525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 795/1585] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.210525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.219889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a65890-81d1-4cc4-9541-b2dab1743331 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.225724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 791/1586] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:51 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:51.225724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.228189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.229111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.229258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.229426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.230328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.232593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.234461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90f42a-fd9a-40a4-b810-10816efd5d0b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.240465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.241236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.241555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.241833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.242556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.244362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.244484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 796/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.245263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.256852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f08c-a173-44f8-81e8-3e1abaa5d981 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.263654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 792/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.263654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.268488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.269426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.269709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.269982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.270709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.272388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.273611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd183a-eaff-41b7-8de1-9fee183fe17f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.280229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.281327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.281607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.281980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.282920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.287057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 797/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.287199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.287304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.295290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62661-53ff-4832-9fcc-47bb6f2b7eb7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.299066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 793/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.299066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.303638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.304342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.304703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.304908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.305675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.307371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.308051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4ab5a-d3eb-4766-b698-72fb2dd52c3a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.313254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.313905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.314188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.314493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.315192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.316996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.318653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 798/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.319485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.329963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1bee-f3ad-4351-b668-679cff8bb335 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.331233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 794/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.332090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.338457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.339072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.339357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.339626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.340318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.342499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.344447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22577ac-5362-449f-8ad9-2960909ecc89 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.350283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.351200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.351742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.352582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.353728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.354390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 799/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.355304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.356019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.366293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b99b4-20c8-4165-b912-87c773b17939 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.371488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 795/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.371488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.387121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.388226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.388508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.388826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.389459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.390845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ff11-f362-443f-8695-d94a9cf163e8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.391242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.398289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.399283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.399571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.399843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.400539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.402576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.409046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 800/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.410123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.413987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 796/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.415008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.424759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a1975-e342-4ffd-9278-b8daf4091c53 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.426830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ca82-04e7-45ba-bfc5-db8cf85707c2 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.430416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.431098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.431406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.431679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] PATH_INFO: `/v3/projects/6d04a48b2f1a43d58b43cb9077bf774a/users/d3f06b052f5d4fdda3a9304b179c9c9c/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.432707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.433320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.433594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.433867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.434616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.436299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.447708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d04a48b2f1a43d58b43cb9077bf774a, user_id=d3f06b052f5d4fdda3a9304b179c9c9c, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.451551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 797/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.451551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.451735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.461440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab17fc-5c1d-4c99-bbdb-a8f89b7473a8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.479929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 801/1598] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:51 2022] PUT /identity/v3/projects/6d04a48b2f1a43d58b43cb9077bf774a/users/d3f06b052f5d4fdda3a9304b179c9c9c/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:51.479929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.537633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.538410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.538719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.539042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] PATH_INFO: `/v3/projects/2bc4aea4b4884176b9fe9bf6a5456ba2/users/aa550d74b152469e97d47b8ffdf7804a/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.557441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc4aea4b4884176b9fe9bf6a5456ba2, user_id=aa550d74b152469e97d47b8ffdf7804a, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.560191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.561823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd962562-f09d-4f2a-bd31-216b09983620 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.572395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.573039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.573318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.573589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.574340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.576489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.577355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 798/1599] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:51 2022] PUT /identity/v3/projects/2bc4aea4b4884176b9fe9bf6a5456ba2/users/aa550d74b152469e97d47b8ffdf7804a/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:51.577994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.615809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 802/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:51.616622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.635560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5efab-95d6-43e6-b872-3d56dc94e0a4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.654203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71623b-b4e4-4192-b090-892563318f35 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.658992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.659750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.660096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.660438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] PATH_INFO: `/v3/projects/5bea0314beaa4139adc70202159c6669/users/8220bbd2970f49cc93721b9b5bb429bb/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.664565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:51.679133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bea0314beaa4139adc70202159c6669, user_id=8220bbd2970f49cc93721b9b5bb429bb, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.682081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.695929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:51.696529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 799/1601] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:51 2022] PUT /identity/v3/projects/5bea0314beaa4139adc70202159c6669/users/8220bbd2970f49cc93721b9b5bb429bb/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:51.699888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.714042 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.716677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.716953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.717223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] PATH_INFO: `/v3/projects/4b9bacecb17b46369ce347a1ac45b0fb/users/64d2c283ac35442ebd3c46569d8062c9/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.733940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9bacecb17b46369ce347a1ac45b0fb, user_id=64d2c283ac35442ebd3c46569d8062c9, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.736738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.755522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 803/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:51 2022] PUT /identity/v3/projects/4b9bacecb17b46369ce347a1ac45b0fb/users/64d2c283ac35442ebd3c46569d8062c9/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:51.755522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:51.777546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7758c-4e58-4bfa-8baf-b14c0642bc98 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.827374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e360-64b4-4176-b0f1-699eea687dd5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:51.832414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1bee2-568b-4203-a893-5cd55b06d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.833205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1bee2-568b-4203-a893-5cd55b06d3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.833587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1bee2-568b-4203-a893-5cd55b06d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.833960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1bee2-568b-4203-a893-5cd55b06d3b7 admin admin] PATH_INFO: `/v3/projects/f31e32be49d14f5eaa75a338239ea4f1/users/9211b8bb93c440308df912f26f016056/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.845142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022ac39-6d26-4674-9b3b-2966245f5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:51.845975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022ac39-6d26-4674-9b3b-2966245f5510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.846431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022ac39-6d26-4674-9b3b-2966245f5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.846777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022ac39-6d26-4674-9b3b-2966245f5510 admin admin] PATH_INFO: `/v3/projects/e2d530f57a74451fadbbfd50e9414c0c/users/33487c94a2e14432985f400aa3d07cfa/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.853111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1bee2-568b-4203-a893-5cd55b06d3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31e32be49d14f5eaa75a338239ea4f1, user_id=9211b8bb93c440308df912f26f016056, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.855670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1bee2-568b-4203-a893-5cd55b06d3b7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.864543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022ac39-6d26-4674-9b3b-2966245f5510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d530f57a74451fadbbfd50e9414c0c, user_id=33487c94a2e14432985f400aa3d07cfa, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:51.867406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022ac39-6d26-4674-9b3b-2966245f5510 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:51.870953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 804/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:51 2022] PUT /identity/v3/projects/f31e32be49d14f5eaa75a338239ea4f1/users/9211b8bb93c440308df912f26f016056/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:51.872531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd50a-c84e-4ee6-b945-854e5e13495c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.873001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd50a-c84e-4ee6-b945-854e5e13495c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.873496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd50a-c84e-4ee6-b945-854e5e13495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.891952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 800/1604] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:51 2022] PUT /identity/v3/projects/e2d530f57a74451fadbbfd50e9414c0c/users/33487c94a2e14432985f400aa3d07cfa/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:51.893411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363fa0-661c-4f6d-82aa-b743e6a00a09 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:51.894405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363fa0-661c-4f6d-82aa-b743e6a00a09 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:51.895767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363fa0-661c-4f6d-82aa-b743e6a00a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:51.919191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-81363fa0-661c-4f6d-82aa-b743e6a00a09 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:51.920418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-81363fa0-661c-4f6d-82aa-b743e6a00a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:51.920543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7d6cd50a-c84e-4ee6-b945-854e5e13495c None None] MFA Rules not processed for user `d3f06b052f5d4fdda3a9304b179c9c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:51.922803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7d6cd50a-c84e-4ee6-b945-854e5e13495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:52.000675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 801/1605] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:52.004408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363fa0-661c-4f6d-82aa-b743e6a00a09 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.017733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363fa0-661c-4f6d-82aa-b743e6a00a09 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.019670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 805/1606] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:52.021119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800bc5-b4a2-4209-a413-2dfdbcbdc98d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.021473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800bc5-b4a2-4209-a413-2dfdbcbdc98d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.021760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800bc5-b4a2-4209-a413-2dfdbcbdc98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.024241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42613033-1022-477d-8441-130088fe0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.025283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42613033-1022-477d-8441-130088fe0035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.026055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42613033-1022-477d-8441-130088fe0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.026577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42613033-1022-477d-8441-130088fe0035 admin admin] PATH_INFO: `/v3/projects/33ee2ca0d7714ef0acee6e379ab89ce4/users/a1bbb2e1b2b146659c23e9b51e3a6fee/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.044196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:52.048652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42613033-1022-477d-8441-130088fe0035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ee2ca0d7714ef0acee6e379ab89ce4, user_id=a1bbb2e1b2b146659c23e9b51e3a6fee, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.053112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42613033-1022-477d-8441-130088fe0035 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:52.060841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-76800bc5-b4a2-4209-a413-2dfdbcbdc98d None None] MFA Rules not processed for user `8220bbd2970f49cc93721b9b5bb429bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:52.062112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-76800bc5-b4a2-4209-a413-2dfdbcbdc98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:52.074213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 802/1607] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:52 2022] PUT /identity/v3/projects/33ee2ca0d7714ef0acee6e379ab89ce4/users/a1bbb2e1b2b146659c23e9b51e3a6fee/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:52.076317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bbbb-b94d-4fac-b542-822e2455c25a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.076740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bbbb-b94d-4fac-b542-822e2455c25a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.077023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bbbb-b94d-4fac-b542-822e2455c25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.112176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f362bbbb-b94d-4fac-b542-822e2455c25a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:52.114338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f362bbbb-b94d-4fac-b542-822e2455c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:52.118887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:52.159476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 806/1608] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:52.161277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5acd-0240-4a47-8e78-9812c5a00f88 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.161566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5acd-0240-4a47-8e78-9812c5a00f88 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.161841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5acd-0240-4a47-8e78-9812c5a00f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.202527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-317e5acd-0240-4a47-8e78-9812c5a00f88 None None] MFA Rules not processed for user `9211b8bb93c440308df912f26f016056`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:52.204410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-317e5acd-0240-4a47-8e78-9812c5a00f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:52.214936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 803/1609] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:52.216555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ff5c-224a-4501-a04a-91257041c8ff None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.216837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ff5c-224a-4501-a04a-91257041c8ff None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.217108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ff5c-224a-4501-a04a-91257041c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.252253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2046ff5c-224a-4501-a04a-91257041c8ff None None] MFA Rules not processed for user `33487c94a2e14432985f400aa3d07cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:52.253947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2046ff5c-224a-4501-a04a-91257041c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:52.311658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 807/1610] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:52.316508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e5acd-0240-4a47-8e78-9812c5a00f88 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.371623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 804/1611] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:52.371623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ff5c-224a-4501-a04a-91257041c8ff None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.387350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ff5c-224a-4501-a04a-91257041c8ff None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.409708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e5acd-0240-4a47-8e78-9812c5a00f88 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.412139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.412797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.413981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.414307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.417630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.420431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acd2cd-4775-4ccc-94b6-ac0878b5b402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.421244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acd2cd-4775-4ccc-94b6-ac0878b5b402 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.421381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acd2cd-4775-4ccc-94b6-ac0878b5b402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.421482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:52.421686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acd2cd-4775-4ccc-94b6-ac0878b5b402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.448409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acd2cd-4775-4ccc-94b6-ac0878b5b402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.449931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acd2cd-4775-4ccc-94b6-ac0878b5b402 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:52.461619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 808/1612] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:52.463144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48838d-dae8-48f0-a6b9-95c7f5cbf782 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.463379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48838d-dae8-48f0-a6b9-95c7f5cbf782 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.463660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48838d-dae8-48f0-a6b9-95c7f5cbf782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.490324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2d48838d-dae8-48f0-a6b9-95c7f5cbf782 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:52.490670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 805/1613] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:52.491422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2d48838d-dae8-48f0-a6b9-95c7f5cbf782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:52.492040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.583691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076e97b-1b35-4e23-868c-87d0a0f40720 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.593612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.593940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.595099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.595450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.618604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 809/1614] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:52.619636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48838d-dae8-48f0-a6b9-95c7f5cbf782 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.628876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:52.649548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:52.689937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.692029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:52.708597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 806/1615] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:52.709829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.725241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48838d-dae8-48f0-a6b9-95c7f5cbf782 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.727983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a16e05-41b2-425c-aa1f-1583b906ceaa service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.734098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.734690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.734974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.735250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.737689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbf62e-807b-43d3-a9b8-37aa2be18650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.738627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf62e-807b-43d3-a9b8-37aa2be18650 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.739115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf62e-807b-43d3-a9b8-37aa2be18650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.739589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf62e-807b-43d3-a9b8-37aa2be18650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.740661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbf62e-807b-43d3-a9b8-37aa2be18650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.743335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbf62e-807b-43d3-a9b8-37aa2be18650 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:52.761119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.763921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:52.786138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 807/1616] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:52.786138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4801-1078-44af-90e7-b98348b1d5be None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.786775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4801-1078-44af-90e7-b98348b1d5be None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.787096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4801-1078-44af-90e7-b98348b1d5be None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.788664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 808/1617] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 28 22:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:15:52.789515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4801-1078-44af-90e7-b98348b1d5be None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.810820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 810/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:52.816398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.842485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07031448-6d94-4a28-9e00-fe0feed29f08 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.909310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4801-1078-44af-90e7-b98348b1d5be None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.915551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.917130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.917423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.917749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.919507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.922589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:52.952864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 809/1619] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:52.958010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:52.970086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e95137-2cb3-464b-8737-7dd40d9d6228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.971282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e95137-2cb3-464b-8737-7dd40d9d6228 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.972022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e95137-2cb3-464b-8737-7dd40d9d6228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.972540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e95137-2cb3-464b-8737-7dd40d9d6228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.983324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e423-dc39-489d-b169-5d1fae60090a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:52.993413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:52.994053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:52.994373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:52.994710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:52.995404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:52.998186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.000903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e95137-2cb3-464b-8737-7dd40d9d6228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.003496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e95137-2cb3-464b-8737-7dd40d9d6228 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.020265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 811/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:53.022451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a339a-0468-495c-8142-344e8b292424 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.023074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a339a-0468-495c-8142-344e8b292424 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.023645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a339a-0468-495c-8142-344e8b292424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.050180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 810/1621] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:15:52 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:15:53.051167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.064603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546235-b9fd-4f60-bd55-c5aa43f70ce3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.071098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.072436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.072730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.073099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.073886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.076305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.091809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d48a339a-0468-495c-8142-344e8b292424 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:53.093093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d48a339a-0468-495c-8142-344e8b292424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:53.102817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 811/1622] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:53.104806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.119579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4ff06-82d7-4529-9d62-e826bf6d284d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.126946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.127673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.128116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.129115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.130139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.136528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.152042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 812/1623] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:53.153098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.169405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd36e9-dceb-4762-97b7-a186974dfb37 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.177115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.177864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.178146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.178552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] PATH_INFO: `/v3/projects/4ff0681d99e04bbdbdd15ecaaced4ad4/users/97608ac1f19843f38049ea42f2b2fbc6/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.198880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff0681d99e04bbdbdd15ecaaced4ad4, user_id=97608ac1f19843f38049ea42f2b2fbc6, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.202577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.289721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 813/1624] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:53 2022] PUT /identity/v3/projects/4ff0681d99e04bbdbdd15ecaaced4ad4/users/97608ac1f19843f38049ea42f2b2fbc6/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:53.289721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.298744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:53.301958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 812/1625] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 28 22:15:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:53.304852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a339a-0468-495c-8142-344e8b292424 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.344990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a339a-0468-495c-8142-344e8b292424 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.382221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b015a-60b3-43ae-9b5c-ee54e6ba9469 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.393670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.395891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.396582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.397332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] PATH_INFO: `/v3/projects/97bfdf7d92b24044bf1e38906bee746a/users/4e65c7c9ba5d49f3a2c09495047b40b8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.423616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bfdf7d92b24044bf1e38906bee746a, user_id=4e65c7c9ba5d49f3a2c09495047b40b8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.428184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.464438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:53.464654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 814/1626] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:53 2022] PUT /identity/v3/projects/97bfdf7d92b24044bf1e38906bee746a/users/4e65c7c9ba5d49f3a2c09495047b40b8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:53.466669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.522583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.523412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.523978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.524154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.525024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.526797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.551285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 813/1627] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:53.552635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.575871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718757-a100-4bec-a4cb-336d255149f2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.607436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfd1b7-822c-4ad7-bb39-67bf54720f2a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.616823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.618117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.618478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.618854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.718254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.722894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.752004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 815/1628] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:53.754508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.769156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.770257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.770381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.770795 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.772210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.774029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.791117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 814/1629] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:15:53.792060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:53.804934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b7d5-f456-4a18-be5e-3599f8f8e15c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:53.811762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948fea5-19e6-476c-aa69-ae6c6031acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:53.812636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948fea5-19e6-476c-aa69-ae6c6031acb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.813049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948fea5-19e6-476c-aa69-ae6c6031acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.813427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948fea5-19e6-476c-aa69-ae6c6031acb4 admin admin] PATH_INFO: `/v3/projects/97bfdf7d92b24044bf1e38906bee746a/users/4e65c7c9ba5d49f3a2c09495047b40b8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.815761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948fea5-19e6-476c-aa69-ae6c6031acb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bfdf7d92b24044bf1e38906bee746a, user_id=4e65c7c9ba5d49f3a2c09495047b40b8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:53.818972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948fea5-19e6-476c-aa69-ae6c6031acb4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:53.851132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 815/1630] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:53 2022] PUT /identity/v3/projects/97bfdf7d92b24044bf1e38906bee746a/users/4e65c7c9ba5d49f3a2c09495047b40b8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:53.852963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57796-a84e-49fa-8629-6537356498f7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:53.853837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57796-a84e-49fa-8629-6537356498f7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:53.854398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57796-a84e-49fa-8629-6537356498f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:53.893838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:53.908508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1ea57796-a84e-49fa-8629-6537356498f7 None None] MFA Rules not processed for user `4e65c7c9ba5d49f3a2c09495047b40b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:53.919787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1ea57796-a84e-49fa-8629-6537356498f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:53.948142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e97bf9-ec26-4cf9-802a-cf045366f61f service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:54.065029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 816/1631] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:54.070790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57796-a84e-49fa-8629-6537356498f7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:54.128048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73572ed-6bc5-40fb-8a4c-c7029a007aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:54.131034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73572ed-6bc5-40fb-8a4c-c7029a007aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.133008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73572ed-6bc5-40fb-8a4c-c7029a007aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.133667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73572ed-6bc5-40fb-8a4c-c7029a007aad admin admin] PATH_INFO: `/v3/projects/4ff0681d99e04bbdbdd15ecaaced4ad4/users/97608ac1f19843f38049ea42f2b2fbc6/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.139752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73572ed-6bc5-40fb-8a4c-c7029a007aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff0681d99e04bbdbdd15ecaaced4ad4, user_id=97608ac1f19843f38049ea42f2b2fbc6, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:54.144511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73572ed-6bc5-40fb-8a4c-c7029a007aad admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:54.173752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:54.184284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 816/1632] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:15:53 2022] PUT /identity/v3/projects/4ff0681d99e04bbdbdd15ecaaced4ad4/users/97608ac1f19843f38049ea42f2b2fbc6/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:54.188962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7362-3fe9-4308-9edc-aed84d47b39d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.190210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7362-3fe9-4308-9edc-aed84d47b39d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.191416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7362-3fe9-4308-9edc-aed84d47b39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.232673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57796-a84e-49fa-8629-6537356498f7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:54.292165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f79f7362-3fe9-4308-9edc-aed84d47b39d None None] MFA Rules not processed for user `97608ac1f19843f38049ea42f2b2fbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:54.295045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f79f7362-3fe9-4308-9edc-aed84d47b39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:54.323513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0098f6-ffea-4a36-bf88-86313cda3b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:54.324315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0098f6-ffea-4a36-bf88-86313cda3b3f service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.324485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0098f6-ffea-4a36-bf88-86313cda3b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.324819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0098f6-ffea-4a36-bf88-86313cda3b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.435867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0098f6-ffea-4a36-bf88-86313cda3b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:54.437493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0098f6-ffea-4a36-bf88-86313cda3b3f service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:54.451850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 817/1633] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:54.453327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907b249-dc09-4612-b1b3-daa97e0ca686 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.454350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907b249-dc09-4612-b1b3-daa97e0ca686 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.454737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907b249-dc09-4612-b1b3-daa97e0ca686 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.465146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 818/1634] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 28 22:15:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:15:54.468041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907b249-dc09-4612-b1b3-daa97e0ca686 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:54.478817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 817/1635] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:15:54.480941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907b249-dc09-4612-b1b3-daa97e0ca686 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:54.482294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71767ff7-6638-4576-a483-7d58e4ccba88 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.484296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71767ff7-6638-4576-a483-7d58e4ccba88 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.484598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71767ff7-6638-4576-a483-7d58e4ccba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.487842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:54.488547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.489968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.490517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.562871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-71767ff7-6638-4576-a483-7d58e4ccba88 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:54.564164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-71767ff7-6638-4576-a483-7d58e4ccba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:54.647138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:54.649186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:54.661894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 819/1636] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:54.732731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:54.733862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 818/1637] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:54.737680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:54.749391 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71767ff7-6638-4576-a483-7d58e4ccba88 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:54.765732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71767ff7-6638-4576-a483-7d58e4ccba88 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:54.779263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1866-9ce5-496c-bfeb-c2d589b45d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:54.781368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1866-9ce5-496c-bfeb-c2d589b45d0e service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.781700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1866-9ce5-496c-bfeb-c2d589b45d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.781979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1866-9ce5-496c-bfeb-c2d589b45d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.808150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f1866-9ce5-496c-bfeb-c2d589b45d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:54.813761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f1866-9ce5-496c-bfeb-c2d589b45d0e service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:54.843831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 819/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:15:54.895398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd3b3-0a97-4249-96a6-fd8b4e42fa38 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:54.904144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:54.904747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:54.905032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:54.905306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] PATH_INFO: `/v3/users/9211b8bb93c440308df912f26f016056` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:54.906630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9211b8bb93c440308df912f26f016056)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:54.908856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:55.004748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9211b8bb93c440308df912f26f016056'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:55.005878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9211b8bb93c440308df912f26f016056'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:55.024928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9211b8bb93c440308df912f26f016056'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:55.026921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9211b8bb93c440308df912f26f016056'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:55.047269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9211b8bb93c440308df912f26f016056'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:55.068165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 820/1639] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:15:54 2022] DELETE /identity/v3/users/9211b8bb93c440308df912f26f016056 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:55.073924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e46b3-bcd3-444b-aac5-2c8da73046ea None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:55.074554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e46b3-bcd3-444b-aac5-2c8da73046ea None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:55.075163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e46b3-bcd3-444b-aac5-2c8da73046ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:55.125823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-320e46b3-bcd3-444b-aac5-2c8da73046ea None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:55.127779 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-320e46b3-bcd3-444b-aac5-2c8da73046ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:55.204205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:55.304999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 820/1640] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:55.670098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:55.672251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:55.765658 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf94fbb-e559-4f08-926e-7d9976c4ef55 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:55.770093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86cee7-8c8e-4804-a928-0281906551c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:55.770841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cee7-8c8e-4804-a928-0281906551c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:55.771187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cee7-8c8e-4804-a928-0281906551c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:55.771525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cee7-8c8e-4804-a928-0281906551c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:55.782401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86cee7-8c8e-4804-a928-0281906551c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:55.784141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86cee7-8c8e-4804-a928-0281906551c9 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:55.796434 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 821/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:55.938612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54442c-2ef6-4ccc-be05-053438c69847 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:55.939157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54442c-2ef6-4ccc-be05-053438c69847 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:55.939157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54442c-2ef6-4ccc-be05-053438c69847 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:55.940518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 821/1642] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 28 22:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:15:55.952744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a7ba2-31ce-4dfb-8191-5636c30bf06a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:55.953316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a7ba2-31ce-4dfb-8191-5636c30bf06a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:55.953316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a7ba2-31ce-4dfb-8191-5636c30bf06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:56.015433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-de2a7ba2-31ce-4dfb-8191-5636c30bf06a None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:56.016674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-de2a7ba2-31ce-4dfb-8191-5636c30bf06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:56.059138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:56.188441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 822/1643] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 28 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:56.195711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f957d6c-2518-48be-b803-719cb7de7fbb None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:56.196029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f957d6c-2518-48be-b803-719cb7de7fbb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:56.196316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f957d6c-2518-48be-b803-719cb7de7fbb None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:56.198616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 822/1644] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 28 22:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:15:56.211674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:56.211674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:56.211959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:56.248575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:15:56.251716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:56.275341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 823/1645] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:15:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:15:56.297135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f957d6c-2518-48be-b803-719cb7de7fbb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:56.298985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1f957d6c-2518-48be-b803-719cb7de7fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:56.448886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f957d6c-2518-48be-b803-719cb7de7fbb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:56.461938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:56.462612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:56.462888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:56.463186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:56.489002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:56.490681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:56.532683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 823/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:57.169889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:57.172031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:57.194891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639ce96-21e0-4a8c-95c4-031dc1ddb8a3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:57.211005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:57.219104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:57.219701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:57.222558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:57.227930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:57.410201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:57.412422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:57.433441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 824/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:15:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:15:58.277050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:58.279797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:15:58.301240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f51702-ea0f-4aa6-9736-7e020fb6a239 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:58.323950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:58.324863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:58.326822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:58.327879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] PATH_INFO: `/v3/projects/f31e32be49d14f5eaa75a338239ea4f1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:58.331616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31e32be49d14f5eaa75a338239ea4f1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:58.333769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:58.457445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31e32be49d14f5eaa75a338239ea4f1', 'request_id': 'req-2b846365-5f92-4065-aca7-db90b335fe35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.477578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31e32be49d14f5eaa75a338239ea4f1', 'request_id': 'req-2b846365-5f92-4065-aca7-db90b335fe35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.487076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31e32be49d14f5eaa75a338239ea4f1', 'request_id': 'req-2b846365-5f92-4065-aca7-db90b335fe35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.511546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] The token cache is being invalidate because project f31e32be49d14f5eaa75a338239ea4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:15:58.511998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.514730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2b846365-5f92-4065-aca7-db90b335fe35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.518984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 824/1648] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:15:58 2022] DELETE /identity/v3/projects/f31e32be49d14f5eaa75a338239ea4f1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:15:58.523190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:15:58.538504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2579f8-ae23-492f-b9bd-2df7603c9df6 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:15:58.658142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:15:58.659930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:15:58.661231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:15:58.662174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] PATH_INFO: `/v3/users/4e65c7c9ba5d49f3a2c09495047b40b8` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:15:58.664880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e65c7c9ba5d49f3a2c09495047b40b8)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:15:58.668743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:15:58.754472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:15:58.757369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e65c7c9ba5d49f3a2c09495047b40b8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.758391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e65c7c9ba5d49f3a2c09495047b40b8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.781221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e65c7c9ba5d49f3a2c09495047b40b8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.785496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e65c7c9ba5d49f3a2c09495047b40b8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.816009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e65c7c9ba5d49f3a2c09495047b40b8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:15:58.867355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 825/1649] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:15:58 2022] DELETE /identity/v3/users/4e65c7c9ba5d49f3a2c09495047b40b8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:00.175289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:00.175848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:00.175848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:00.222431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] MFA Rules not processed for user `c3b5516b045444cc959043157a4367ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:00.223701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:00.299339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:00.348340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 825/1650] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:00.365824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:00.369077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:00.369496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:00.371025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:00.454336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32c96c-5026-44ca-a616-5d70349bf059 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:00.460565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:00.461432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:00.461823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:00.462663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] PATH_INFO: `/v3/projects/97bfdf7d92b24044bf1e38906bee746a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:00.463611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bfdf7d92b24044bf1e38906bee746a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:00.466338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:00.524765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0b0e-e61b-4002-b42c-5e57432f1efd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:00.544265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bfdf7d92b24044bf1e38906bee746a', 'request_id': 'req-d6598e77-7306-4b4a-9764-e6c0309dc561'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:00.556324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bfdf7d92b24044bf1e38906bee746a', 'request_id': 'req-d6598e77-7306-4b4a-9764-e6c0309dc561'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:00.569654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bfdf7d92b24044bf1e38906bee746a', 'request_id': 'req-d6598e77-7306-4b4a-9764-e6c0309dc561'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:00.594714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] The token cache is being invalidate because project 97bfdf7d92b24044bf1e38906bee746a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:00.595255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:00.597778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d6598e77-7306-4b4a-9764-e6c0309dc561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:00.600468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 826/1651] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:00 2022] DELETE /identity/v3/projects/97bfdf7d92b24044bf1e38906bee746a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:00.621474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23fa4-5b1e-4399-b580-d3746a1c2740 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:00.622006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23fa4-5b1e-4399-b580-d3746a1c2740 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:00.623276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23fa4-5b1e-4399-b580-d3746a1c2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:00.660380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:00.661345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:00.662428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:00.663324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:00.670676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:00.685923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-aff23fa4-5b1e-4399-b580-d3746a1c2740 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:00.688410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-aff23fa4-5b1e-4399-b580-d3746a1c2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:00.804089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:00.806599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:00.820077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:00.835108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 827/1652] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:00.845186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0df5-3a79-441b-8f9a-d3d60973c52b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:00.845588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0df5-3a79-441b-8f9a-d3d60973c52b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:00.845942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0df5-3a79-441b-8f9a-d3d60973c52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:00.849933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 826/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:00.892766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-230b0df5-3a79-441b-8f9a-d3d60973c52b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:00.894392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-230b0df5-3a79-441b-8f9a-d3d60973c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:00.914137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:00.925701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 828/1654] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:00.956142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d53258-8fba-4d07-b16e-a431d8897cfc service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:00.966141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:00.967149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:00.967952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:00.968723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:00.969993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:00.971773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:00.974068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:01.013112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 827/1655] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:01.017538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0df5-3a79-441b-8f9a-d3d60973c52b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:01.043797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0df5-3a79-441b-8f9a-d3d60973c52b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:01.053796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:01.062644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.063011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.063518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.064354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:01.067342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:01.089727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:01.143652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 829/1656] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:01 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:01.147618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:01.163741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761c62-97ba-4c55-b275-9b95e2727b32 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:01.332552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:01.333307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.333678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.334086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.336226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:01.349354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:01.415276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 828/1657] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:01 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:01.416534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:01.446828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d10e-6172-4b90-b92c-ca2f63c4de59 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:01.456426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:01.457347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:01.464413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:01.466741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.467148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.467524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.468763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:01.476486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:01.483018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a528c-c604-4d3c-a99b-23d23a6ab525 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:01.491907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:01.494480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.495288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.496367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] PATH_INFO: `/v3/users/33487c94a2e14432985f400aa3d07cfa` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.499744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=33487c94a2e14432985f400aa3d07cfa)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:01.504681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:01.522645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 830/1658] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:01.529256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:01.565428 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bf020-9904-4665-a1af-a334192fa6ff admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:01.592667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:01.602979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.603833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.605608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.606603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:01.614158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:01.660902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33487c94a2e14432985f400aa3d07cfa'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:01.661356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 831/1659] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:01.662366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:01.662921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33487c94a2e14432985f400aa3d07cfa'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:01.685633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33487c94a2e14432985f400aa3d07cfa'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:01.688830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33487c94a2e14432985f400aa3d07cfa'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:01.694478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a8c8-e48c-479b-ba11-c57bcdef2708 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:01.727555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-92bf4036-f402-496c-8e40-aa7d2f3f3eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33487c94a2e14432985f400aa3d07cfa'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:01.757067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21028f-e0af-4f8a-97ae-e30fcb7d06c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:01.760607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21028f-e0af-4f8a-97ae-e30fcb7d06c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.760921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21028f-e0af-4f8a-97ae-e30fcb7d06c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.761214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21028f-e0af-4f8a-97ae-e30fcb7d06c8 admin admin] PATH_INFO: `/v3/projects/41aafd3a6b5941ebb5b631653efad13f/users/37f85ca91a4a442e828c5ddb683d1c7e/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.763464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 829/1660] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:01 2022] DELETE /identity/v3/users/33487c94a2e14432985f400aa3d07cfa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:01.770479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.770848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.771247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.789969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21028f-e0af-4f8a-97ae-e30fcb7d06c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41aafd3a6b5941ebb5b631653efad13f, user_id=37f85ca91a4a442e828c5ddb683d1c7e, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:01.794650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21028f-e0af-4f8a-97ae-e30fcb7d06c8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:01.835277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 832/1661] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:01 2022] PUT /identity/v3/projects/41aafd3a6b5941ebb5b631653efad13f/users/37f85ca91a4a442e828c5ddb683d1c7e/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:01.835460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:01.840293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:01.841393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:01.841834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:01.847785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:01.907203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:01.942644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 830/1662] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:01.959788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] MFA Rules not processed for user `37f85ca91a4a442e828c5ddb683d1c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:01.961021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:01.997840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:01.999412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:02.183379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac7f58-58fa-4a60-8e35-110d7e711fee None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:02.198461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 833/1663] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:02.198614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:02.198614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:02.198614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:02.198614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:02.201130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:02.202572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:02.221960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:02.229582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:02.254080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8267e-abc7-4e0a-b586-18017dca3350 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:02.261703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 831/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:02.275937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:02.279520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:02.279520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:02.282102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:02.282914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:02.298683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:02.366186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 834/1665] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:02 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:02.370120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:02.388294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97135aa3-d8cb-46f4-b575-fde24341b8a7 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:02.520754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:02.524058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:02.525094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:02.525607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:02.527437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:02.530603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:02.575904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 832/1666] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:02 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:02.579901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:02.596932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c74b05-a108-480c-a55f-2bdcb66229af admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:02.608911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:02.609555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:02.609837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:02.610160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:02.613161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:02.615082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:02.640550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 835/1667] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:02.644568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:02.657685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a134304-d0f3-4743-8a37-94f3a1335d4a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:02.679950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:02.681128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:02.681572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:02.681916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] PATH_INFO: `/v3/projects/d2fb28b418ed4d7887ae089884cd4137/users/a143e2abe9fd44a58b9cf2ca0d6a7fbc/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:02.727753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fb28b418ed4d7887ae089884cd4137, user_id=a143e2abe9fd44a58b9cf2ca0d6a7fbc, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:02.732148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:02.776756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 833/1668] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:02 2022] PUT /identity/v3/projects/d2fb28b418ed4d7887ae089884cd4137/users/a143e2abe9fd44a58b9cf2ca0d6a7fbc/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:02.778466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:02.797077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3dcc-d86e-4f8e-b805-71afcd48e7ce admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:02.877792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:02.879807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:03.068887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:03.096251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:03.099707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:03.104215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:03.104215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:03.104623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:03.112950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:03.142504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:03.168560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 836/1669] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:03.172357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9b412-7a36-482f-94be-3d2f27a54050 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:03.173546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:03.187877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:03.190563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:03.190848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:03.191129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] PATH_INFO: `/v3/users/d3f06b052f5d4fdda3a9304b179c9c9c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:03.194145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f06b052f5d4fdda3a9304b179c9c9c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:03.201935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645306b2-6452-4cc9-ab46-9a202937e6b2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:03.202397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:03.215047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d655865-19eb-47ee-b0da-d70a712b6e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:03.216703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655865-19eb-47ee-b0da-d70a712b6e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:03.217345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655865-19eb-47ee-b0da-d70a712b6e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:03.217630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655865-19eb-47ee-b0da-d70a712b6e96 admin admin] PATH_INFO: `/v3/projects/d2fb28b418ed4d7887ae089884cd4137/users/a143e2abe9fd44a58b9cf2ca0d6a7fbc/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:03.223163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655865-19eb-47ee-b0da-d70a712b6e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fb28b418ed4d7887ae089884cd4137, user_id=a143e2abe9fd44a58b9cf2ca0d6a7fbc, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:03.229216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655865-19eb-47ee-b0da-d70a712b6e96 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:03.262440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 837/1670] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:03 2022] PUT /identity/v3/projects/d2fb28b418ed4d7887ae089884cd4137/users/a143e2abe9fd44a58b9cf2ca0d6a7fbc/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:03.277276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:03.283015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:03.283656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:03.337773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f06b052f5d4fdda3a9304b179c9c9c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.338561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f06b052f5d4fdda3a9304b179c9c9c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.363923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f06b052f5d4fdda3a9304b179c9c9c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.367103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f06b052f5d4fdda3a9304b179c9c9c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.379648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] MFA Rules not processed for user `a143e2abe9fd44a58b9cf2ca0d6a7fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:03.386500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:03.411314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-53c15437-b62f-400e-b963-606f8af5648a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f06b052f5d4fdda3a9304b179c9c9c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.442565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 834/1671] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:02 2022] DELETE /identity/v3/users/d3f06b052f5d4fdda3a9304b179c9c9c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:03.445292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:03.446070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:03.447666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:03.498802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:03.501322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:03.593453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 838/1672] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:03.607611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:03.609610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:03.657511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 835/1673] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:03.674222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:03.675796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:03.697515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd517800-0130-415c-93f7-71b06d1c9ad6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:03.707149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:03.707948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:03.708578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:03.708578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] PATH_INFO: `/v3/projects/e2d530f57a74451fadbbfd50e9414c0c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:03.712373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d530f57a74451fadbbfd50e9414c0c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:03.713426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: WARNING py.warnings [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:16:03.713426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: warnings.warn(msg) Jul 28 22:16:03.713426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: Jul 28 22:16:03.714733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:03.774963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7da63-c8cf-436f-a867-6764f6119a52 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:03.839472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d530f57a74451fadbbfd50e9414c0c', 'request_id': 'req-de55c452-3577-411a-8f91-cf55ff9575fc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.867286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d530f57a74451fadbbfd50e9414c0c', 'request_id': 'req-de55c452-3577-411a-8f91-cf55ff9575fc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.887131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d530f57a74451fadbbfd50e9414c0c', 'request_id': 'req-de55c452-3577-411a-8f91-cf55ff9575fc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.900432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa03ff0-38c6-45e3-8659-d013107f0a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:03.901452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03ff0-38c6-45e3-8659-d013107f0a99 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:03.901942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03ff0-38c6-45e3-8659-d013107f0a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:03.902453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03ff0-38c6-45e3-8659-d013107f0a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:03.904965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:03.909020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] The token cache is being invalidate because project e2d530f57a74451fadbbfd50e9414c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:03.909379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.910133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:03.912286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 836/1674] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:03 2022] DELETE /identity/v3/projects/e2d530f57a74451fadbbfd50e9414c0c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:03.913408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:03.920142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:03.966635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:04.040214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa03ff0-38c6-45e3-8659-d013107f0a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.042340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa03ff0-38c6-45e3-8659-d013107f0a99 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.066143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55c452-3577-411a-8f91-cf55ff9575fc admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.068312 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 839/1675] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:04.071070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff3dd-1127-4e7f-86fd-29c42add3698 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.071400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff3dd-1127-4e7f-86fd-29c42add3698 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.071638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff3dd-1127-4e7f-86fd-29c42add3698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.073371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.075568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.075853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.076126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.083400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:04.124303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d6dff3dd-1127-4e7f-86fd-29c42add3698 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:04.131456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d6dff3dd-1127-4e7f-86fd-29c42add3698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:04.297546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.299914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.315945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 837/1676] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:04.317662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:04.325974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 840/1677] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:04.326586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:04.327786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d11816-20ff-44b4-b475-1fbfdf7cdc3b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.328182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d11816-20ff-44b4-b475-1fbfdf7cdc3b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.328448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d11816-20ff-44b4-b475-1fbfdf7cdc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.367314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b5d11816-20ff-44b4-b475-1fbfdf7cdc3b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:04.371192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b5d11816-20ff-44b4-b475-1fbfdf7cdc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:04.395525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 841/1678] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:04.397573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d11816-20ff-44b4-b475-1fbfdf7cdc3b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:04.414754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d11816-20ff-44b4-b475-1fbfdf7cdc3b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.426059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.426157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.426489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.426786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.427647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:04.428051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.429625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.459863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2769-2059-458c-b9cc-37ca24d08eba service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.464791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 842/1679] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:16:04.466570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:04.471388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.473174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.473476 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.473830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.479393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:04.485902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414e49c-a962-4955-ab9d-244fc8e17792 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.499066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.499719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.500001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.500362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.501152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.503086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.579706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 843/1680] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:04 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:04.583967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:04.588155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.590064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.603067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 838/1681] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:04.681705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91d430-f13d-472d-9831-24283a36641b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.698524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.699062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.699345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.699620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.703231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.708862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.764942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 844/1682] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:04 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:04.769292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:04.782605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:04.796538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393d53c-5fda-4c0f-a2ca-79a0cebed6a5 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.820740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.821664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.822119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.822555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.823688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.825679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.847183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 839/1683] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:04.851118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:04.874226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3036c-0dcf-4ae4-8840-a8f253d10802 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.886797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eb540-e1ee-4322-ac13-55ef4d2aae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.889659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb540-e1ee-4322-ac13-55ef4d2aae91 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.890102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb540-e1ee-4322-ac13-55ef4d2aae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.891844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eb540-e1ee-4322-ac13-55ef4d2aae91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.892738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eb540-e1ee-4322-ac13-55ef4d2aae91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:04.896378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eb540-e1ee-4322-ac13-55ef4d2aae91 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:04.923307 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 845/1684] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:04.933879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:04.959370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c79d0-fe90-4366-af34-b49fdf4ef95e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:04.971357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964c036-fb3c-4a20-b49a-76462c6f0e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:04.971745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c036-fb3c-4a20-b49a-76462c6f0e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.972097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c036-fb3c-4a20-b49a-76462c6f0e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.972456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c036-fb3c-4a20-b49a-76462c6f0e22 admin admin] PATH_INFO: `/v3/projects/9e78e0cbaecd404d80a4b4caacc61459/users/ca4147ea682f41bba635ceff4dd70322/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:04.985428 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:04.987224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:04.987224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:05.024922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] MFA Rules not processed for user `c3b5516b045444cc959043157a4367ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:05.028834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964c036-fb3c-4a20-b49a-76462c6f0e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e78e0cbaecd404d80a4b4caacc61459, user_id=ca4147ea682f41bba635ceff4dd70322, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:05.029806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:05.032150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964c036-fb3c-4a20-b49a-76462c6f0e22 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:05.054935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:05.064931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 840/1685] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:04 2022] PUT /identity/v3/projects/9e78e0cbaecd404d80a4b4caacc61459/users/ca4147ea682f41bba635ceff4dd70322/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:05.067358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8223c-b1e9-4537-bc1c-3a8d25ef7ad6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:05.067752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8223c-b1e9-4537-bc1c-3a8d25ef7ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:05.068141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8223c-b1e9-4537-bc1c-3a8d25ef7ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:05.101456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-1ef8223c-b1e9-4537-bc1c-3a8d25ef7ad6 None None] MFA Rules not processed for user `ca4147ea682f41bba635ceff4dd70322`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:05.102941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1ef8223c-b1e9-4537-bc1c-3a8d25ef7ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:05.180527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 846/1686] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:05.200212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:05.203232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:05.235719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 841/1687] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:05.237004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8223c-b1e9-4537-bc1c-3a8d25ef7ad6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:05.257935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4c1b2-86fb-434a-b558-bcee39ff558c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:05.346895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8223c-b1e9-4537-bc1c-3a8d25ef7ad6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:05.362275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:05.363046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:05.363323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:05.363594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:05.365608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:05.368491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:05.463115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 842/1688] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:05 2022] POST /identity/v3/projects => generated 393 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:05.464802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:05.487502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:05.488542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:05.490563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:05.491784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] PATH_INFO: `/v3/projects/6d04a48b2f1a43d58b43cb9077bf774a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:05.495948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d04a48b2f1a43d58b43cb9077bf774a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:05.499556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:05.600328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:05.638152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d04a48b2f1a43d58b43cb9077bf774a', 'request_id': 'req-724ff3ef-cb57-4109-b30a-b8d1bf147716'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:05.642569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67165-bef3-4ae8-90a0-083b1b58fa73 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:05.656552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d04a48b2f1a43d58b43cb9077bf774a', 'request_id': 'req-724ff3ef-cb57-4109-b30a-b8d1bf147716'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:05.664937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d04a48b2f1a43d58b43cb9077bf774a', 'request_id': 'req-724ff3ef-cb57-4109-b30a-b8d1bf147716'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:05.689236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] The token cache is being invalidate because project 6d04a48b2f1a43d58b43cb9077bf774a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:05.689998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:05.690907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:05.702099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 847/1689] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:05 2022] DELETE /identity/v3/projects/6d04a48b2f1a43d58b43cb9077bf774a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:05.703560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:05.709082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:05.806654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:05.807410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:05.807698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:05.807973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:05.808833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:05.812261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:05.877092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 843/1690] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:05 2022] POST /identity/v3/users => generated 303 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:05.883359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:05.894146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:05.918136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:05.928931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a179ed9-e94b-433d-a5c6-ac992bf4ae71 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:05.939268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:05.942207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:05.943785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:05.946641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:05.947955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:05.952805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:05.961689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff3ef-cb57-4109-b30a-b8d1bf147716 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:05.978608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:05.979294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:05.979574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:05.979847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] PATH_INFO: `/v3/users/97608ac1f19843f38049ea42f2b2fbc6` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:05.985218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 844/1691] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:05.987937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97608ac1f19843f38049ea42f2b2fbc6)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:05.989329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:05.993533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: WARNING py.warnings [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 22:16:05.993533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: warnings.warn(msg) Jul 28 22:16:05.993533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: Jul 28 22:16:05.995227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:06.009375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fff4c-f115-4a45-9f27-a45561755f95 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:06.020240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:06.020924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.021210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.021490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] PATH_INFO: `/v3/projects/cb6ee98a45b144d6af2aafa5fedb5f80/users/48376c16e8db4db99744953d06fd20ff/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.072561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6ee98a45b144d6af2aafa5fedb5f80, user_id=48376c16e8db4db99744953d06fd20ff, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:06.077362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:06.089632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97608ac1f19843f38049ea42f2b2fbc6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:06.091478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97608ac1f19843f38049ea42f2b2fbc6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:06.105416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97608ac1f19843f38049ea42f2b2fbc6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:06.118268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 845/1692] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:05 2022] PUT /identity/v3/projects/cb6ee98a45b144d6af2aafa5fedb5f80/users/48376c16e8db4db99744953d06fd20ff/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:06.122292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:06.128184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97608ac1f19843f38049ea42f2b2fbc6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:06.220117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa050613-5618-41bc-8d43-4667e65f3897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97608ac1f19843f38049ea42f2b2fbc6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:06.234258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 848/1693] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:05 2022] DELETE /identity/v3/users/97608ac1f19843f38049ea42f2b2fbc6 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:06.260443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487e64-f043-4c50-8c8c-a98c51c4ce3e None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.260876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487e64-f043-4c50-8c8c-a98c51c4ce3e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.261416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487e64-f043-4c50-8c8c-a98c51c4ce3e None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.263638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 849/1694] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 28 22:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:16:06.272061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0080728-b823-49c8-bf55-bad03118eab5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.272611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0080728-b823-49c8-bf55-bad03118eab5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.272985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0080728-b823-49c8-bf55-bad03118eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.339937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30f9b-a2de-4cea-921e-b0d59c3ba965 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:06.361081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d0080728-b823-49c8-bf55-bad03118eab5 None None] MFA Rules not processed for user `ba7594ae41184fb09cd2399b7f35616e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:06.364803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d0080728-b823-49c8-bf55-bad03118eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:06.466571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:06.488195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:06.488842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.489123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.489395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.490113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:06.492031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:06.511933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 846/1695] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:06.516415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:06.518962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:06.540228 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 850/1696] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:16:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:06.545437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74538b42-4747-469a-9d72-0ea8ac393576 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:06.558809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:06.560430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.560922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.561421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] PATH_INFO: `/v3/projects/cb6ee98a45b144d6af2aafa5fedb5f80/users/48376c16e8db4db99744953d06fd20ff/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.564810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6ee98a45b144d6af2aafa5fedb5f80, user_id=48376c16e8db4db99744953d06fd20ff, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:06.568741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:06.583159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 847/1697] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:06 2022] PUT /identity/v3/projects/cb6ee98a45b144d6af2aafa5fedb5f80/users/48376c16e8db4db99744953d06fd20ff/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:06.593557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.593851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.594127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.620786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:06.623248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:06.640994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] MFA Rules not processed for user `48376c16e8db4db99744953d06fd20ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:06.643147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:06.708384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:06.785376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 851/1698] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:06.786728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:06.791577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:06.802843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962606-5306-4452-a643-57620e76ae4f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:06.821261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:06.821922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.822182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.822489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.849854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:06.851265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:06.886120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 848/1699] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:06.887038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:06.899201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:06.962595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75934-1983-4afe-a1bb-59e38b30bc6f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:06.972956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:06.973793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:06.974135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:06.974513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] PATH_INFO: `/v3/users/8220bbd2970f49cc93721b9b5bb429bb` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:06.977287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8220bbd2970f49cc93721b9b5bb429bb)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:06.979353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:07.063390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87c3fe-392b-4c9d-81dd-31eec4e6760d service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:07.073740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:07.076225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:07.077943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:07.078328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:07.086494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8220bbd2970f49cc93721b9b5bb429bb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:07.087496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8220bbd2970f49cc93721b9b5bb429bb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:07.108858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8220bbd2970f49cc93721b9b5bb429bb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:07.114040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:07.117891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8220bbd2970f49cc93721b9b5bb429bb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:07.120814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:07.148291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa712531-19c7-49b8-ace9-48abeb441c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8220bbd2970f49cc93721b9b5bb429bb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:07.171298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 852/1700] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:06 2022] DELETE /identity/v3/users/8220bbd2970f49cc93721b9b5bb429bb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:07.173373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:07.173774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:07.174070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:07.178684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 849/1701] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:07.223976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:07.225297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:07.296626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:07.299491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:07.324551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303e15-90cf-46ed-a4d6-cdd9ae15faa5 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:07.326189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 853/1702] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:07.365398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:07.366966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:07.374119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:07.452326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:07.452888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:07.453165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:07.453437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:07.459991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:07.512836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d9e1-7f29-44d5-9636-d825ad414c57 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:07.522833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:07.523822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:07.523822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:07.524026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:07.531865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:07.548514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:07.550020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:07.577304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 854/1703] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:07.593707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:07.595203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:07.612544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 850/1704] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:08.518679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:08.521063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:08.561295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca4fea-b34b-4bbc-9880-0cce6e78369e service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:08.576002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:08.576699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:08.576974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:08.577268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] PATH_INFO: `/v3/users/37f85ca91a4a442e828c5ddb683d1c7e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:08.579700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f85ca91a4a442e828c5ddb683d1c7e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:08.581658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:08.706002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:08.706492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f85ca91a4a442e828c5ddb683d1c7e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.706960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f85ca91a4a442e828c5ddb683d1c7e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.707178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:08.733183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f85ca91a4a442e828c5ddb683d1c7e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.745028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f85ca91a4a442e828c5ddb683d1c7e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.752210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400f9be-70ad-4478-bf98-229c2de49923 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:08.773168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23321a88-e513-4191-929b-d16c45875278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f85ca91a4a442e828c5ddb683d1c7e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.773377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:08.775549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:08.775979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:08.776445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] PATH_INFO: `/v3/projects/4ff0681d99e04bbdbdd15ecaaced4ad4` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:08.779800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff0681d99e04bbdbdd15ecaaced4ad4)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:08.785108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:08.794306 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 855/1705] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:08 2022] DELETE /identity/v3/users/37f85ca91a4a442e828c5ddb683d1c7e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:08.800537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:08.800841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:08.801119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:08.843631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:08.844847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:08.919517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff0681d99e04bbdbdd15ecaaced4ad4', 'request_id': 'req-ca588c28-3cf8-40dd-bc92-135544869407'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.938926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff0681d99e04bbdbdd15ecaaced4ad4', 'request_id': 'req-ca588c28-3cf8-40dd-bc92-135544869407'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.963470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff0681d99e04bbdbdd15ecaaced4ad4', 'request_id': 'req-ca588c28-3cf8-40dd-bc92-135544869407'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.990665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] The token cache is being invalidate because project 4ff0681d99e04bbdbdd15ecaaced4ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:08.990856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.992087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ca588c28-3cf8-40dd-bc92-135544869407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:08.998908 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 851/1706] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:08 2022] DELETE /identity/v3/projects/4ff0681d99e04bbdbdd15ecaaced4ad4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:09.000507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dc2a1-e0b3-464b-9063-9e890d381e15 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.000797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dc2a1-e0b3-464b-9063-9e890d381e15 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.001058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dc2a1-e0b3-464b-9063-9e890d381e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.049549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 856/1707] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:09.054310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f20dc2a1-e0b3-464b-9063-9e890d381e15 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:09.055593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f20dc2a1-e0b3-464b-9063-9e890d381e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:09.242423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:09.243000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 852/1708] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:09.253680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:09.257661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0efa3-f6a4-4a4e-8247-58003d17d416 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.258207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0efa3-f6a4-4a4e-8247-58003d17d416 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.258801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0efa3-f6a4-4a4e-8247-58003d17d416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.349431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:09.383975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fdf0efa3-f6a4-4a4e-8247-58003d17d416 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:09.388985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fdf0efa3-f6a4-4a4e-8247-58003d17d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:09.429061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 853/1709] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:09.430782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0efe-87a1-43b9-8cbd-79a38c5d4e64 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.431150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0efe-87a1-43b9-8cbd-79a38c5d4e64 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.431502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0efe-87a1-43b9-8cbd-79a38c5d4e64 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.447365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 854/1710] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jul 28 22:16:09 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:16:09.448072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf98b37-5b1a-4d64-a69e-16d889021654 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:09.452168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0efe-87a1-43b9-8cbd-79a38c5d4e64 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:09.485062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0efe-87a1-43b9-8cbd-79a38c5d4e64 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:09.490945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0b178-4fda-464a-9088-d5eebae23e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:09.491739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0b178-4fda-464a-9088-d5eebae23e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.492032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0b178-4fda-464a-9088-d5eebae23e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.492378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0b178-4fda-464a-9088-d5eebae23e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.493184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0b178-4fda-464a-9088-d5eebae23e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:09.493638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0b178-4fda-464a-9088-d5eebae23e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:09.496513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0b178-4fda-464a-9088-d5eebae23e4e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:09.514869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 855/1711] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:09.516745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae3085-03e0-4693-b1b2-0f262be2e629 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.517184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae3085-03e0-4693-b1b2-0f262be2e629 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.517633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae3085-03e0-4693-b1b2-0f262be2e629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.561024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-4cae3085-03e0-4693-b1b2-0f262be2e629 None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:09.582529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4cae3085-03e0-4693-b1b2-0f262be2e629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:09.615711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:09.622041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.622450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.622733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.634010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:09.675014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:09.684249 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:09.693931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 856/1712] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jul 28 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:09.694920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae3085-03e0-4693-b1b2-0f262be2e629 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:09.711548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae3085-03e0-4693-b1b2-0f262be2e629 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:09.728982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:09.729629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.730166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.730476 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.731784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:09.736569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:09.736739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 857/1713] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:09.737437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:09.782191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0e586-1d74-485e-89de-19141ccf39c8 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:09.792481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 857/1714] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:09 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:09.799077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:09.810734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:09.811534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:09.816882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:09.817224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:09.824792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:09.874462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:09.876305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:09.917247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 858/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:09.989220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b99f9-361c-42c5-affd-67eeba1fe123 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:10.002109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:10.003077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.004605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.005873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.009988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:10.017686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:10.089733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 858/1716] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:09 2022] POST /identity/v3/users => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:10.094683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:10.114930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584032d0-9de2-4b87-9d30-9ebd456bf3ef service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:10.145400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:10.146048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.146366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.146641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.147345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:10.161040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:10.196872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:10.205609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 859/1717] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:10.206650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:10.209242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:10.220011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46893d4-d399-4bb1-a40f-e63d17a685ac admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:10.230159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce115-71f5-4396-a01a-30fba39b7e7f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:10.236522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:10.237217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.237495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.237767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] PATH_INFO: `/v3/projects/5bea0314beaa4139adc70202159c6669` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.239348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:10.240252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.240626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.240966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.242024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:10.244562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bea0314beaa4139adc70202159c6669)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:10.245119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:10.246723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:10.281392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 859/1718] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:10.282620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:10.308231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9a9c-bb20-489f-86ed-5be9832caca5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:10.331715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb449-396e-4c26-8fe6-354c2b113000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:10.332227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bea0314beaa4139adc70202159c6669', 'request_id': 'req-12d471e0-e13b-45c3-a13e-ef76ae423714'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:10.332595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb449-396e-4c26-8fe6-354c2b113000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.333080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb449-396e-4c26-8fe6-354c2b113000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.333445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb449-396e-4c26-8fe6-354c2b113000 admin admin] PATH_INFO: `/v3/projects/5b970efece504b1fa0fc46883c2a6eba/users/c16f3ab1f240459488014b3ba504b2fd/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.346432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bea0314beaa4139adc70202159c6669', 'request_id': 'req-12d471e0-e13b-45c3-a13e-ef76ae423714'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:10.356786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bea0314beaa4139adc70202159c6669', 'request_id': 'req-12d471e0-e13b-45c3-a13e-ef76ae423714'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:10.378970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] The token cache is being invalidate because project 5bea0314beaa4139adc70202159c6669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:10.379510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:10.380246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-12d471e0-e13b-45c3-a13e-ef76ae423714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:10.383229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb449-396e-4c26-8fe6-354c2b113000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b970efece504b1fa0fc46883c2a6eba, user_id=c16f3ab1f240459488014b3ba504b2fd, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:10.383455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 860/1719] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:10 2022] DELETE /identity/v3/projects/5bea0314beaa4139adc70202159c6669 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:10.389227 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71149d0-0056-42d3-988d-4b6b6bcd25b9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.389791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71149d0-0056-42d3-988d-4b6b6bcd25b9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.390262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb449-396e-4c26-8fe6-354c2b113000 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:10.390483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71149d0-0056-42d3-988d-4b6b6bcd25b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.419576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 860/1720] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:10 2022] PUT /identity/v3/projects/5b970efece504b1fa0fc46883c2a6eba/users/c16f3ab1f240459488014b3ba504b2fd/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:10.441533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.441820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.442096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.493880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e71149d0-0056-42d3-988d-4b6b6bcd25b9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:10.495854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e71149d0-0056-42d3-988d-4b6b6bcd25b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:10.559895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] MFA Rules not processed for user `c16f3ab1f240459488014b3ba504b2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:10.561144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:10.577586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:10.683801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 861/1721] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:10.691709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71f06-6da8-4e23-b985-5ef69988d51e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.691995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71f06-6da8-4e23-b985-5ef69988d51e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.692260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71f06-6da8-4e23-b985-5ef69988d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.741294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-71d71f06-6da8-4e23-b985-5ef69988d51e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:10.752891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-71d71f06-6da8-4e23-b985-5ef69988d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:10.774432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 862/1722] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:10.786557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d71f06-6da8-4e23-b985-5ef69988d51e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:10.807738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:10.810058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d71f06-6da8-4e23-b985-5ef69988d51e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:10.820537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7c49c-7219-47ca-af7d-19dafeff3f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:10.821851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7c49c-7219-47ca-af7d-19dafeff3f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.822060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7c49c-7219-47ca-af7d-19dafeff3f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.822355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7c49c-7219-47ca-af7d-19dafeff3f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.825413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7c49c-7219-47ca-af7d-19dafeff3f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:10.825805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7c49c-7219-47ca-af7d-19dafeff3f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:10.828024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 861/1723] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:10.836268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7c49c-7219-47ca-af7d-19dafeff3f41 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:10.838655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:10.841505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:10.878737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 863/1724] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:10.879205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5711d-b318-4d30-bcc0-3b22248c8edd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.879556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5711d-b318-4d30-bcc0-3b22248c8edd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.879837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5711d-b318-4d30-bcc0-3b22248c8edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.884485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf71dd1-e5b7-4bec-803c-5e03c5ac27a6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:10.912431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:10.913192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:10.913687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:10.914063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:10.914984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:10.919195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:10.972919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d6d5711d-b318-4d30-bcc0-3b22248c8edd None None] MFA Rules not processed for user `a1bbb2e1b2b146659c23e9b51e3a6fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:10.976384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d6d5711d-b318-4d30-bcc0-3b22248c8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:10.994056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 862/1725] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:10 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:10.994878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:11.164021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db51c-37dd-4c92-b945-7020fc43eb78 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:11.170697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b5153-b36e-48bb-ae4c-995deed33085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:11.171351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b5153-b36e-48bb-ae4c-995deed33085 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.171639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b5153-b36e-48bb-ae4c-995deed33085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.172056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b5153-b36e-48bb-ae4c-995deed33085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.172746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b5153-b36e-48bb-ae4c-995deed33085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:11.175167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b5153-b36e-48bb-ae4c-995deed33085 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:11.230880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 864/1726] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:11.238912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5711d-b318-4d30-bcc0-3b22248c8edd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:11.243455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 863/1727] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:10 2022] POST /identity/v3/projects => generated 373 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:11.248065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75580-25ea-4a30-8156-43c43426158e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.248410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75580-25ea-4a30-8156-43c43426158e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.248714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75580-25ea-4a30-8156-43c43426158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.275163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5711d-b318-4d30-bcc0-3b22248c8edd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:11.300383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-96a75580-25ea-4a30-8156-43c43426158e None None] MFA Rules not processed for user `a1bbb2e1b2b146659c23e9b51e3a6fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:11.303422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-96a75580-25ea-4a30-8156-43c43426158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:11.491540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:11.492616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.494503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.494993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.496014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:11.502676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:11.531567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 864/1728] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:11.532537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a75580-25ea-4a30-8156-43c43426158e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:11.561089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a75580-25ea-4a30-8156-43c43426158e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:11.576149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:11.578362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.578362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.578651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.579716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:11.587705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:11.605599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 865/1729] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:11 2022] POST /identity/v3/users => generated 307 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:11.641798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:11.645786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:11.678775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 865/1730] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:11 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:11.681906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:11.720447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab139acc-2d46-4053-b165-fd6ad02a24b4 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:11.750476 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:11.751577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.753222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.754320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.756698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:11.766288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:11.773433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:11.843684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1793e-1b04-4268-8f05-ac67d7734d2b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:11.851779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 866/1731] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:11.851779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:11.855928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534e492-7aed-4edb-8df0-9300d1416b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:11.868397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534e492-7aed-4edb-8df0-9300d1416b34 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.868832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534e492-7aed-4edb-8df0-9300d1416b34 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.869118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534e492-7aed-4edb-8df0-9300d1416b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.879951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e3cde-c1d7-4ba0-892b-81d24197545b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:11.892167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534e492-7aed-4edb-8df0-9300d1416b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:11.895373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534e492-7aed-4edb-8df0-9300d1416b34 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:11.913359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 866/1732] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:11.916108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2cc0a-8898-4c9d-875e-f990073f0b77 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.916552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2cc0a-8898-4c9d-875e-f990073f0b77 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.916959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2cc0a-8898-4c9d-875e-f990073f0b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.931522 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:11.932175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:11.932474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:11.932746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:11.933480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:11.937893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:11.965156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cfc2cc0a-8898-4c9d-875e-f990073f0b77 None None] MFA Rules not processed for user `64d2c283ac35442ebd3c46569d8062c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:11.974727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 867/1733] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:11.979153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cfc2cc0a-8898-4c9d-875e-f990073f0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:11.981783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:11.992507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:12.017268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac142-a287-48c3-b3c0-9f404c86b85d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:12.034275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:12.034942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.035223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.035497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] PATH_INFO: `/v3/projects/41aafd3a6b5941ebb5b631653efad13f` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.037175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41aafd3a6b5941ebb5b631653efad13f)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:12.039263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:12.082127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:12.112500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 867/1734] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:12.112643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2cc0a-8898-4c9d-875e-f990073f0b77 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:12.153288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41aafd3a6b5941ebb5b631653efad13f', 'request_id': 'req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.163029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41aafd3a6b5941ebb5b631653efad13f', 'request_id': 'req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.165094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2cc0a-8898-4c9d-875e-f990073f0b77 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:12.173054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41aafd3a6b5941ebb5b631653efad13f', 'request_id': 'req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.198974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] The token cache is being invalidate because project 41aafd3a6b5941ebb5b631653efad13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:12.199313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.203714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-82d1c9e9-ebb7-4272-95ed-a6ed8fa71f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.213090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 868/1735] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:11 2022] DELETE /identity/v3/projects/41aafd3a6b5941ebb5b631653efad13f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:12.213090 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.213492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.213919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.285287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] MFA Rules not processed for user `aa550d74b152469e97d47b8ffdf7804a`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:12.285459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:12.285922 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.286333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.286869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] PATH_INFO: `/v3/projects/d248c8261ca947ee8fea5bcd0893822c/users/c14744ba5e68488aa0e18fe2bca9ca7d/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.286977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:12.308027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d248c8261ca947ee8fea5bcd0893822c, user_id=c14744ba5e68488aa0e18fe2bca9ca7d, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:12.311650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:12.337759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 868/1736] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:12 2022] PUT /identity/v3/projects/d248c8261ca947ee8fea5bcd0893822c/users/c14744ba5e68488aa0e18fe2bca9ca7d/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:12.338699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:12.343859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:12.499591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 869/1737] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:12.511706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:12.519207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:12.521920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:12.588709 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f33f-50fe-4feb-bfa9-bf31d3590941 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:12.610628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:12.611307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.611587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.611860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] PATH_INFO: `/v3/users/a143e2abe9fd44a58b9cf2ca0d6a7fbc` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.613152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a143e2abe9fd44a58b9cf2ca0d6a7fbc)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:12.616392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:12.626141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d18e0-e8f0-4508-91cc-01a61ccaf5fa admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:12.643022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:12.643257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.645830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.646191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.646947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:12.651492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:12.671275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 869/1738] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:12.672257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:12.676088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:12.694458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419f60-5d24-4578-8f80-6f98a49b8050 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:12.700073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:12.700734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.701605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.701954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.704480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:12.706498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:12.719681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 870/1739] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:12.720806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:12.723041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a143e2abe9fd44a58b9cf2ca0d6a7fbc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.723808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a143e2abe9fd44a58b9cf2ca0d6a7fbc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.727729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:12.736438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a143e2abe9fd44a58b9cf2ca0d6a7fbc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.744278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a143e2abe9fd44a58b9cf2ca0d6a7fbc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.766610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ae160c56-e7f8-419f-8a4d-9754de63fda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a143e2abe9fd44a58b9cf2ca0d6a7fbc'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:12.792633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 870/1740] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:12 2022] DELETE /identity/v3/users/a143e2abe9fd44a58b9cf2ca0d6a7fbc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:12.792633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230598-3324-41a1-9d20-38a68a19c92d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.792633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230598-3324-41a1-9d20-38a68a19c92d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.792633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230598-3324-41a1-9d20-38a68a19c92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.825879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14058267-db8a-4ff4-ba38-020bcabc1b73 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:12.844314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-31230598-3324-41a1-9d20-38a68a19c92d None None] MFA Rules not processed for user `aa550d74b152469e97d47b8ffdf7804a`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:12.848115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-31230598-3324-41a1-9d20-38a68a19c92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:12.863731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:12.960655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:12.961651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:12.962144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:12.962631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:12.967804 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:13.059159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 871/1741] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:13.060646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03687946-a402-44b1-a7bc-cb9d3478da46 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:13.060931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03687946-a402-44b1-a7bc-cb9d3478da46 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:13.061205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03687946-a402-44b1-a7bc-cb9d3478da46 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:13.064988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 872/1742] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 28 22:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:16:13.065816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03687946-a402-44b1-a7bc-cb9d3478da46 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:13.072809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-03687946-a402-44b1-a7bc-cb9d3478da46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:13.164452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:13.169033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:13.173476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:13.209273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 871/1743] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:13.221822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:13.230504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:13.325017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03687946-a402-44b1-a7bc-cb9d3478da46 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:13.338600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9218ec-37f0-43e1-8fe6-d8a6bb27c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:13.340994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9218ec-37f0-43e1-8fe6-d8a6bb27c18a admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:13.345269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9218ec-37f0-43e1-8fe6-d8a6bb27c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:13.345651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9218ec-37f0-43e1-8fe6-d8a6bb27c18a admin admin] PATH_INFO: `/v3/projects/b315e0690cb94d2c9b96a2d62003a801/users/57a444b58ba94745b456202cc5f9a97f/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:13.380176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9218ec-37f0-43e1-8fe6-d8a6bb27c18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b315e0690cb94d2c9b96a2d62003a801, user_id=57a444b58ba94745b456202cc5f9a97f, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:13.384365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9218ec-37f0-43e1-8fe6-d8a6bb27c18a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:13.445451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 873/1744] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:13 2022] PUT /identity/v3/projects/b315e0690cb94d2c9b96a2d62003a801/users/57a444b58ba94745b456202cc5f9a97f/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:13.448086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:13.450414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:13.450771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:13.458127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae570f4-3bb2-4b45-9944-23ba2f8b1362 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:13.492352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] MFA Rules not processed for user `ba7594ae41184fb09cd2399b7f35616e`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:13.493771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:13.633112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:13.634405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:13.634696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:13.634970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] PATH_INFO: `/v3/projects/d248c8261ca947ee8fea5bcd0893822c/users/c14744ba5e68488aa0e18fe2bca9ca7d/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:13.645673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 874/1745] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:13.646494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:13.648099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:13.648539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d248c8261ca947ee8fea5bcd0893822c, user_id=c14744ba5e68488aa0e18fe2bca9ca7d, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:13.651352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:13.674457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7434d-81a0-4617-9e32-5d28c25622f7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:13.685040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 872/1746] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:13 2022] PUT /identity/v3/projects/d248c8261ca947ee8fea5bcd0893822c/users/c14744ba5e68488aa0e18fe2bca9ca7d/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:13.685895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:13.696067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:13.792011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:13.825790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:13.826661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:13.827037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:13.827414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] PATH_INFO: `/v3/users/ca4147ea682f41bba635ceff4dd70322` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:13.829023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4147ea682f41bba635ceff4dd70322)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:13.833294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:13.873290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db8fbb-af52-456d-a97d-33e4101506e0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:13.896999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:13.897807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:13.898091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:13.898585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:13.905115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:13.936494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4147ea682f41bba635ceff4dd70322'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:13.938308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4147ea682f41bba635ceff4dd70322'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:13.954963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4147ea682f41bba635ceff4dd70322'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:13.959027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4147ea682f41bba635ceff4dd70322'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:13.986271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c55765b7-019f-47c1-9ebd-ee2f6453a275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4147ea682f41bba635ceff4dd70322'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:14.013467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 875/1747] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:13 2022] DELETE /identity/v3/users/ca4147ea682f41bba635ceff4dd70322 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:14.014926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cdae-d858-4de9-b528-e1ed7b9bcf1a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:14.015318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cdae-d858-4de9-b528-e1ed7b9bcf1a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:14.015690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cdae-d858-4de9-b528-e1ed7b9bcf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:14.023334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:14.065616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ac41cdae-d858-4de9-b528-e1ed7b9bcf1a None None] MFA Rules not processed for user `57a444b58ba94745b456202cc5f9a97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:14.067157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ac41cdae-d858-4de9-b528-e1ed7b9bcf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.081537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:14.083214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:14.107768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 873/1748] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:14.108647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:14.111373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.207946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 876/1749] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:14.210703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282812-32ee-46f2-af21-179badd41481 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:14.210994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282812-32ee-46f2-af21-179badd41481 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:14.211274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282812-32ee-46f2-af21-179badd41481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:14.258749 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d7af-ad14-4b38-8b1e-43e0b79a6aab service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:14.284687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-4b282812-32ee-46f2-af21-179badd41481 None None] MFA Rules not processed for user `c14744ba5e68488aa0e18fe2bca9ca7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:14.288545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4b282812-32ee-46f2-af21-179badd41481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.385038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc4e5-7669-4519-aca0-cb0030dde128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:14.385617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc4e5-7669-4519-aca0-cb0030dde128 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:14.385903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc4e5-7669-4519-aca0-cb0030dde128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:14.386178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc4e5-7669-4519-aca0-cb0030dde128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:14.393332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0f7fc4e5-7669-4519-aca0-cb0030dde128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.395122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:14.430609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fc4e5-7669-4519-aca0-cb0030dde128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:14.439757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fc4e5-7669-4519-aca0-cb0030dde128 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:14.439995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 877/1750] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:14.440889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282812-32ee-46f2-af21-179badd41481 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:14.445197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4b282812-32ee-46f2-af21-179badd41481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.507092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 874/1751] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:14.508591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:14.508884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:14.509162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:14.630224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282812-32ee-46f2-af21-179badd41481 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:14.643723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:14.644334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:14.644609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:14.644881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] PATH_INFO: `/v3/projects/d2fb28b418ed4d7887ae089884cd4137` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:14.647935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fb28b418ed4d7887ae089884cd4137)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:14.648743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:14.692637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:14.696572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.803581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fb28b418ed4d7887ae089884cd4137', 'request_id': 'req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:14.820354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fb28b418ed4d7887ae089884cd4137', 'request_id': 'req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:14.842365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fb28b418ed4d7887ae089884cd4137', 'request_id': 'req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:14.868034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] The token cache is being invalidate because project d2fb28b418ed4d7887ae089884cd4137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:14.868449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:14.870793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2cadf3ad-bb57-4d5e-8a8d-5b3a3f18f5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:14.877245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 878/1752] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:14 2022] DELETE /identity/v3/projects/d2fb28b418ed4d7887ae089884cd4137 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:14.877245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:14.877245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:14.877245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:14.919154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 875/1753] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:14.920365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:14.923650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.926902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:14.928692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:14.951342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:14.962156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b007f68-341b-44de-ac93-c8e2a08e6127 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:15.096967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16df870-1209-4a08-aca3-f7e9a91a393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:15.097623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df870-1209-4a08-aca3-f7e9a91a393e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:15.097938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df870-1209-4a08-aca3-f7e9a91a393e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:15.098280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df870-1209-4a08-aca3-f7e9a91a393e admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:15.100784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16df870-1209-4a08-aca3-f7e9a91a393e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:15.102815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16df870-1209-4a08-aca3-f7e9a91a393e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:15.147214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 879/1754] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:15.148702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:15.150579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:15.171980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:15.178290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 876/1755] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:14 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:15.186435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:15.186793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:15.187120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:15.255071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:15.271569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:15.280030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fcd16-4aa8-4ef5-81df-dfb7f30dda15 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:15.422205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:15.423273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:15.424524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:15.425045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:15.428307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:15.448344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 877/1756] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:15.450670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:15.453298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:15.481682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09672155-6c70-404d-b1d4-c5f4c2fc6025 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:15.495494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:15.496145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:15.496465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:15.496743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:15.497437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:15.503210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:15.576761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 878/1757] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:15 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:15.578755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:15.581754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:15.648747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:15.650247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:15.686444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 880/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:15.687111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:15.691878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:15.735461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31338-842a-4d72-878e-f4e0ae25eea4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:15.744806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf23d6-fcd3-4785-8efc-d2d1f9e396bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:15.745453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf23d6-fcd3-4785-8efc-d2d1f9e396bd service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:15.745729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf23d6-fcd3-4785-8efc-d2d1f9e396bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:15.748384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf23d6-fcd3-4785-8efc-d2d1f9e396bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:15.774183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf23d6-fcd3-4785-8efc-d2d1f9e396bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:15.778720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf23d6-fcd3-4785-8efc-d2d1f9e396bd service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:15.829787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 879/1759] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:15.831058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3b57-3bb0-49b6-b3d4-963b63603ec0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:15.831342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3b57-3bb0-49b6-b3d4-963b63603ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:15.831614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3b57-3bb0-49b6-b3d4-963b63603ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:15.912052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d11e3b57-3bb0-49b6-b3d4-963b63603ec0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:15.915712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d11e3b57-3bb0-49b6-b3d4-963b63603ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:15.941073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 880/1760] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:15.941668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3b57-3bb0-49b6-b3d4-963b63603ec0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:15.967769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3b57-3bb0-49b6-b3d4-963b63603ec0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:15.971433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:15.980238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:15.984708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:15.984996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:15.985282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:15.988747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:15.993716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:15.998083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b1fe1-2ff9-4345-bf1d-aa95cec7d85a service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:16.000515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:16.017224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:16.018076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:16.018386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:16.018660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:16.023232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 881/1761] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:16.024142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:16.030514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:16.042309 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391e064-d91f-4ac7-8595-c15ae78963df admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:16.051433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:16.052600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:16.053101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:16.053565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:16.056487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:16.176947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:16.183087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:16.225979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 882/1762] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:16.227898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:16.250383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:16.260271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:16.274951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9a63c-07b5-415c-bafc-600e6860973f service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:16.298871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:16.301953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 881/1763] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:16:16.303238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:16.303589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:16.303849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:16.304299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:16.305103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:16.305415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:16.315753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:16.369445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a5045-4595-4bca-b4a4-c3423d909363 service swift] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:16.415062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 883/1764] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:16.419655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:16.429089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:16.432750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:16.437074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:16.439300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] PATH_INFO: `/v3/projects/8e4f19f05183482a9bbf74777376a409/users/b4220d453af04b9f85074a5431f841b4/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:16.446781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfdf4b-bfa1-4056-b9dc-a9168006867a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:16.462035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:16.463542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:16.465657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:16.467511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:16.468339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:16.486783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:16.529406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4f19f05183482a9bbf74777376a409, user_id=b4220d453af04b9f85074a5431f841b4, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:16.556578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:16.626277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 882/1765] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:16 2022] PUT /identity/v3/projects/8e4f19f05183482a9bbf74777376a409/users/b4220d453af04b9f85074a5431f841b4/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:16.632039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:16.680051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 884/1766] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:16 2022] POST /identity/v3/projects => generated 365 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:16.682570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:16.910724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12c385-f6e0-4b58-bd39-c4572f1c5c3e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:17.005168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68af3-051b-4921-b307-4a06799b447b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:17.035224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:17.040355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.045572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.046131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:17.047002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:17.059534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:17.116728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:17.119813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.119996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.120221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:17.122916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:17.142800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:17.161204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 885/1767] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:16 2022] POST /identity/v3/users => generated 283 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:17.164807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:17.204013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 883/1768] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:16:17.207514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:17.223534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2c983-fbaa-4522-9a25-262cd80834af admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:17.240825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bacc2-36fb-47ed-a09f-d616cb9d8604 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:17.250085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:17.251719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.252881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.253637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f38fe7-adc2-4f55-85f9-b4c1604ec7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:17.254358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38fe7-adc2-4f55-85f9-b4c1604ec7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.254644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38fe7-adc2-4f55-85f9-b4c1604ec7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.255063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:17.257304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38fe7-adc2-4f55-85f9-b4c1604ec7ed admin admin] PATH_INFO: `/v3/projects/8e4f19f05183482a9bbf74777376a409/users/b4220d453af04b9f85074a5431f841b4/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:17.259753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:17.263477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38fe7-adc2-4f55-85f9-b4c1604ec7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4f19f05183482a9bbf74777376a409, user_id=b4220d453af04b9f85074a5431f841b4, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:17.265716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:17.270392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38fe7-adc2-4f55-85f9-b4c1604ec7ed admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:17.308173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 886/1769] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:17.310103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:17.324285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 884/1770] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:17 2022] PUT /identity/v3/projects/8e4f19f05183482a9bbf74777376a409/users/b4220d453af04b9f85074a5431f841b4/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:17.342105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac344a-b054-4856-824a-51bbd218cad5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.342441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac344a-b054-4856-824a-51bbd218cad5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.342689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac344a-b054-4856-824a-51bbd218cad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:17.352198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bad11a-f0ec-45c3-8627-86706abbd0dc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:17.356940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:17.482981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:17.489472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-b0ac344a-b054-4856-824a-51bbd218cad5 None None] MFA Rules not processed for user `b4220d453af04b9f85074a5431f841b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:17.490925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b0ac344a-b054-4856-824a-51bbd218cad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:17.639233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:17.641271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.642757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.644565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:17.648366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:17.657454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:17.706123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 887/1771] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:17.711021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:17.759144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7bd17-e057-4bba-91cf-55cc0c67c18e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:17.788246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb366d06-becf-4554-9623-73db5ef4fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:17.789095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb366d06-becf-4554-9623-73db5ef4fb74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.789374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb366d06-becf-4554-9623-73db5ef4fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.789646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb366d06-becf-4554-9623-73db5ef4fb74 admin admin] PATH_INFO: `/v3/projects/c1ef6702a3f548e8af3a554e96094c97/users/27893f2e7fc7422fa309dacbc1c3bf65/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:17.883989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb366d06-becf-4554-9623-73db5ef4fb74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ef6702a3f548e8af3a554e96094c97, user_id=27893f2e7fc7422fa309dacbc1c3bf65, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:17.891850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb366d06-becf-4554-9623-73db5ef4fb74 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:17.899085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 885/1772] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:17.916115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac344a-b054-4856-824a-51bbd218cad5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:17.946196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 888/1773] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:17 2022] PUT /identity/v3/projects/c1ef6702a3f548e8af3a554e96094c97/users/27893f2e7fc7422fa309dacbc1c3bf65/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:17.958414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d2c6a-8b8a-407d-b160-f55719ce99f8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:17.958699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d2c6a-8b8a-407d-b160-f55719ce99f8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:17.958986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d2c6a-8b8a-407d-b160-f55719ce99f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:18.071520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3c4d2c6a-8b8a-407d-b160-f55719ce99f8 None None] MFA Rules not processed for user `27893f2e7fc7422fa309dacbc1c3bf65`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:18.072952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3c4d2c6a-8b8a-407d-b160-f55719ce99f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:18.150474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac344a-b054-4856-824a-51bbd218cad5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:18.310551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 889/1774] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:18.312130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4ab0-f40c-4fcc-a694-36a65d4995da None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:18.313045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4ab0-f40c-4fcc-a694-36a65d4995da None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:18.316259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4ab0-f40c-4fcc-a694-36a65d4995da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:18.352457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b5ef3-5fbd-4f5b-be8c-991be40510d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:18.353984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b5ef3-5fbd-4f5b-be8c-991be40510d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:18.354441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b5ef3-5fbd-4f5b-be8c-991be40510d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:18.358086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b5ef3-5fbd-4f5b-be8c-991be40510d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:18.374122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d4fb4ab0-f40c-4fcc-a694-36a65d4995da None None] MFA Rules not processed for user `64d2c283ac35442ebd3c46569d8062c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:18.378780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d4fb4ab0-f40c-4fcc-a694-36a65d4995da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:18.632942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:18.647477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b5ef3-5fbd-4f5b-be8c-991be40510d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:18.649387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b5ef3-5fbd-4f5b-be8c-991be40510d2 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:18.662219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 890/1775] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:18.671965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb4ab0-f40c-4fcc-a694-36a65d4995da None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:18.697246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 886/1776] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 781 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:19.024685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:19.098970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:19.099229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:19.099573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:19.110764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb4ab0-f40c-4fcc-a694-36a65d4995da None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:19.127024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:19.131641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:19.134101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:19.134697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:19.135540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:19.151209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:19.197247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] MFA Rules not processed for user `aa550d74b152469e97d47b8ffdf7804a`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:19.209135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:19.280469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 891/1777] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:18 2022] POST /identity/v3/projects => generated 369 bytes in 618 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:19.289948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:19.400320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 887/1778] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:19.437296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:19.438899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:19.502634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64390c7-2cc7-40e7-9c9b-dea576cbebe1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:19.577023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61a76-3f89-4e5f-bf73-ffd163905839 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:19.602870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:19.604582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:19.604879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:19.605156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:19.608631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:19.615389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:19.669223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 892/1779] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:19 2022] POST /identity/v3/users => generated 291 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:19.670368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:19.714570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8408ff0-3086-46fd-a7bf-02c86f4e02cc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:19.729343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:19.730616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:19.731136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:19.731608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:19.732646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:19.744499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:19.767876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 893/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:19.769092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:19.790778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e039a-fa47-4a53-a638-0364946208ff admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:19.825113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:19.828911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:19.831860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:19.832347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] PATH_INFO: `/v3/projects/ef85d8af73db4619a22e6467efd44956/users/4bcc78e363854a1e96a646ee781bf9a1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:19.848437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:19.849219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:19.849508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:19.851729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] PATH_INFO: `/v3/projects/9e78e0cbaecd404d80a4b4caacc61459` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:19.858569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e78e0cbaecd404d80a4b4caacc61459)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:19.865446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:19.895152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef85d8af73db4619a22e6467efd44956, user_id=4bcc78e363854a1e96a646ee781bf9a1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:19.915980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:19.963824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 894/1781] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:19 2022] PUT /identity/v3/projects/ef85d8af73db4619a22e6467efd44956/users/4bcc78e363854a1e96a646ee781bf9a1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:19.965385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:20.084589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e78e0cbaecd404d80a4b4caacc61459', 'request_id': 'req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.110818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e78e0cbaecd404d80a4b4caacc61459', 'request_id': 'req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.141928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e78e0cbaecd404d80a4b4caacc61459', 'request_id': 'req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.173640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] The token cache is being invalidate because project 9e78e0cbaecd404d80a4b4caacc61459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:20.174134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.179557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.186344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 888/1782] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:19 2022] DELETE /identity/v3/projects/9e78e0cbaecd404d80a4b4caacc61459 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:20.189743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:20.192551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:20.214955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932f809-46ec-4025-91cc-29b98cf328a7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:20.293808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:20.295842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:20.354660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:20.356339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:20.357069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:20.357625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] PATH_INFO: `/v3/users/57a444b58ba94745b456202cc5f9a97f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:20.365551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a444b58ba94745b456202cc5f9a97f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:20.367289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16fb6f-06e9-4c71-aec0-fdd37effdd4e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:20.370565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:20.373715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:20.374678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:20.375101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:20.375527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:20.376593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:20.408204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:20.432884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 889/1783] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:20.432884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:20.432884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:20.448856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef456c35-0a8a-42c6-8975-ed75a53251cf admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:20.465341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:20.466879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:20.467666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:20.468886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] PATH_INFO: `/v3/users/48376c16e8db4db99744953d06fd20ff` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:20.473635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48376c16e8db4db99744953d06fd20ff)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:20.487041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:20.512747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a444b58ba94745b456202cc5f9a97f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.513533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a444b58ba94745b456202cc5f9a97f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.529790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a444b58ba94745b456202cc5f9a97f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.561192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a444b58ba94745b456202cc5f9a97f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.590636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a444b58ba94745b456202cc5f9a97f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.608828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 895/1784] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:19 2022] DELETE /identity/v3/users/57a444b58ba94745b456202cc5f9a97f => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:20.611161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:20.614143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:20.659471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48376c16e8db4db99744953d06fd20ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.660469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48376c16e8db4db99744953d06fd20ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.675366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48376c16e8db4db99744953d06fd20ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.679446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48376c16e8db4db99744953d06fd20ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.722042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b27972b-eb74-4338-9519-53bb88e4949e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48376c16e8db4db99744953d06fd20ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:20.756370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 890/1785] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:20 2022] DELETE /identity/v3/users/48376c16e8db4db99744953d06fd20ff => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:20.758220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22530a-7baf-4538-a693-0ed0df1b9e6e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:20.760353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22530a-7baf-4538-a693-0ed0df1b9e6e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:20.762364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22530a-7baf-4538-a693-0ed0df1b9e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:20.815042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ba22530a-7baf-4538-a693-0ed0df1b9e6e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:20.816881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ba22530a-7baf-4538-a693-0ed0df1b9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:20.863791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2be03e-4587-4efa-bb92-ac6bbdd5d0ab admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:21.056250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ee789-b06c-40b6-ad56-a1b2a2c2e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:21.057032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee789-b06c-40b6-ad56-a1b2a2c2e49c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:21.057233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee789-b06c-40b6-ad56-a1b2a2c2e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:21.059699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee789-b06c-40b6-ad56-a1b2a2c2e49c admin admin] PATH_INFO: `/v3/projects/ef85d8af73db4619a22e6467efd44956/users/4bcc78e363854a1e96a646ee781bf9a1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:21.063627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ee789-b06c-40b6-ad56-a1b2a2c2e49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef85d8af73db4619a22e6467efd44956, user_id=4bcc78e363854a1e96a646ee781bf9a1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:21.072020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ee789-b06c-40b6-ad56-a1b2a2c2e49c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:21.081163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:21.095437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 896/1786] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:20 2022] PUT /identity/v3/projects/ef85d8af73db4619a22e6467efd44956/users/4bcc78e363854a1e96a646ee781bf9a1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:21.109588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:21.110068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:21.110178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:21.167386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 891/1787] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:21.172227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:21.176250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:21.177754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:21.183226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] MFA Rules not processed for user `ba7594ae41184fb09cd2399b7f35616e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:21.184435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:21.309919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] MFA Rules not processed for user `4bcc78e363854a1e96a646ee781bf9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:21.311212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:21.479619 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:21.483275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 897/1788] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jul 28 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:21.484212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:21.490658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:21.540105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8297d3-af82-4ff9-a30c-96e1695efb47 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:21.557793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:21.558589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:21.558806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:21.559082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:21.593620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 892/1789] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:21.595221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:21.599964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:21.787537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:21.790657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ebb8c-f490-44b2-be44-85506a821184 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:21.792487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:21.806950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:21.810245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:21.810245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:21.810245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:21.828451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 898/1790] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:21.844500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:21.847534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:21.869992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:21.871624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:21.897908 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 893/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:21.905640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525456-0394-4287-9eba-da6019c91573 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:21.916142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:21.916824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:21.917110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:21.917388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] PATH_INFO: `/v3/projects/cb6ee98a45b144d6af2aafa5fedb5f80` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:21.922082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6ee98a45b144d6af2aafa5fedb5f80)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:21.927063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:21.995333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:21.998070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.022911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0405f1-bad1-4f78-99a3-901e91aeeb41 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:22.039028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:22.039685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:22.039957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:22.040232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:22.055528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.099569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6ee98a45b144d6af2aafa5fedb5f80', 'request_id': 'req-32153754-0e61-4aa3-8447-f55cac13a0a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.126214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6ee98a45b144d6af2aafa5fedb5f80', 'request_id': 'req-32153754-0e61-4aa3-8447-f55cac13a0a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.145906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6ee98a45b144d6af2aafa5fedb5f80', 'request_id': 'req-32153754-0e61-4aa3-8447-f55cac13a0a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.189008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] The token cache is being invalidate because project cb6ee98a45b144d6af2aafa5fedb5f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:22.189327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.195519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-32153754-0e61-4aa3-8447-f55cac13a0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.204709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 899/1792] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:21 2022] DELETE /identity/v3/projects/cb6ee98a45b144d6af2aafa5fedb5f80 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:22.210515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf847-e94f-4d01-9d56-c5ea8708f7bb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:22.210797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf847-e94f-4d01-9d56-c5ea8708f7bb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:22.211077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabf847-e94f-4d01-9d56-c5ea8708f7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:22.324890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-feabf847-e94f-4d01-9d56-c5ea8708f7bb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:22.328265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-feabf847-e94f-4d01-9d56-c5ea8708f7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.350142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:22.358565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:22.380794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:22.401234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 894/1793] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:22.537255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 900/1794] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:22.544455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:22.545008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:22.546260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.549230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:22.549667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:22.576267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e177e8-4334-4743-bca6-1b7dac52df10 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:22.590431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:22.593139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:22.593427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:22.593710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] PATH_INFO: `/v3/users/c16f3ab1f240459488014b3ba504b2fd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:22.599971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16f3ab1f240459488014b3ba504b2fd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:22.602115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:22.611611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:22.615553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.645212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 901/1795] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:22.646668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:22.660799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.771319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16f3ab1f240459488014b3ba504b2fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.774904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16f3ab1f240459488014b3ba504b2fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.797722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16f3ab1f240459488014b3ba504b2fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.798618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16f3ab1f240459488014b3ba504b2fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.820905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:22.831594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7bb54-1f84-4b06-886c-d5075e12bca1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:22.849009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8187166-9878-47be-b3f3-47e6e3642f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:22.850062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8187166-9878-47be-b3f3-47e6e3642f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:22.850867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8187166-9878-47be-b3f3-47e6e3642f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:22.851467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8187166-9878-47be-b3f3-47e6e3642f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:22.854083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c8187166-9878-47be-b3f3-47e6e3642f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.863465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16f3ab1f240459488014b3ba504b2fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:22.876106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8187166-9878-47be-b3f3-47e6e3642f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:22.882085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8187166-9878-47be-b3f3-47e6e3642f5f service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:22.913664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 895/1796] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:22 2022] DELETE /identity/v3/users/c16f3ab1f240459488014b3ba504b2fd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:22.914906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:22.916043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 902/1797] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:22.917581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:22.919140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:22.919752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:22.920352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:22.994709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:22.997940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:23.096840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 903/1798] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:23.118770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75bc9b-a1dd-477f-900b-c71faabccee5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:23.128324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:23.130368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:23.130655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:23.131039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:23.132646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:23.133037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:23.146561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:23.171844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:23.175262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:23.191601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 896/1799] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:23.195737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:23.231556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4474af-0e3f-44be-93f0-86b58f6489ba admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:23.254066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:23.254781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:23.255065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:23.255416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:23.260821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:23.264812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:23.369089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 897/1800] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:23 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:23.373478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:23.380420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac75f4-9fcb-426b-a180-c5909ac92310 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:23.413500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:23.546990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:23.548452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:23.553540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:23.554045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:23.564492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94839c9d-e8e6-4dc9-9ba9-18596328ca39 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:23.582694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:23.585441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:23.585728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:23.586007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:23.587174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:23.588127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:23.588623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:23.594907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:23.624980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 904/1801] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:23.680857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 898/1802] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:23 2022] POST /identity/v3/users => generated 305 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:23.686032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:23.699681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b99d-94cc-4eea-bc7a-427c14429c91 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:23.715925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:23.732799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:23.736341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:23.736641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:23.739589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:23.744419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:23.778459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 905/1803] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:23.781440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:23.804764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ca5fb-c99c-405a-8cb7-3eac37b4c496 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:23.819538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc873d-a9f3-48e7-b124-f5a5a4233837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:23.822055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc873d-a9f3-48e7-b124-f5a5a4233837 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:23.822397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc873d-a9f3-48e7-b124-f5a5a4233837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:23.822679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc873d-a9f3-48e7-b124-f5a5a4233837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:23.827198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc873d-a9f3-48e7-b124-f5a5a4233837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:23.831732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc873d-a9f3-48e7-b124-f5a5a4233837 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:23.872269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:23.881856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 899/1804] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:23.890752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7f4a-f160-446e-927b-05b84065fa51 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:23.903442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:23.903920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:23.904199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:23.904471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] PATH_INFO: `/v3/projects/fc09fa16f0594e93b67ad34229998d8c/users/7725fc3c36c944c4b677500e2517820c/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:23.955758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc09fa16f0594e93b67ad34229998d8c, user_id=7725fc3c36c944c4b677500e2517820c, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:23.967376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:24.004385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 906/1805] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:23 2022] PUT /identity/v3/projects/fc09fa16f0594e93b67ad34229998d8c/users/7725fc3c36c944c4b677500e2517820c/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:24.016300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:24.016589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:24.017176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:24.141537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] MFA Rules not processed for user `7725fc3c36c944c4b677500e2517820c`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:24.146948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:24.249815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:24.438816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 900/1806] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:24.443285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:24.479126 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:24.480907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:24.770001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b6bc6-02cc-49a2-9256-6bd951453edc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:24.788521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:24.790156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fc769-6dd1-4d4f-ad30-c6f50354ee53 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:24.791520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:24.792733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:24.793255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:24.797891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:24.801671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:24.816049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:24.819654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:24.820603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:24.822946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] PATH_INFO: `/v3/projects/b315e0690cb94d2c9b96a2d62003a801` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:24.826314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b315e0690cb94d2c9b96a2d62003a801)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:24.832399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:24.890163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 907/1807] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:24 2022] POST /identity/v3/projects => generated 409 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:24.893308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:24.976293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b315e0690cb94d2c9b96a2d62003a801', 'request_id': 'req-fa2c28d4-3420-4d00-b406-9e7e48d15593'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.005015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b315e0690cb94d2c9b96a2d62003a801', 'request_id': 'req-fa2c28d4-3420-4d00-b406-9e7e48d15593'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.042765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b315e0690cb94d2c9b96a2d62003a801', 'request_id': 'req-fa2c28d4-3420-4d00-b406-9e7e48d15593'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.085302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] The token cache is being invalidate because project b315e0690cb94d2c9b96a2d62003a801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:25.090304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.093922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.101861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 901/1808] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:24 2022] DELETE /identity/v3/projects/b315e0690cb94d2c9b96a2d62003a801 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:25.113007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:25.129484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:25.188641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe849a-fcc8-419a-b68e-e5c7c33847dc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:25.234782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:25.387659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:25.448311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c28d4-3420-4d00-b406-9e7e48d15593 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:25.450571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:25.454279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:25.454688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:25.455079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:25.456761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:25.459852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:25.471057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:25.472869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:25.480724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:25.481359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] PATH_INFO: `/v3/users/b4220d453af04b9f85074a5431f841b4` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:25.484626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4220d453af04b9f85074a5431f841b4)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:25.488811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:25.554015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 908/1809] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:24 2022] POST /identity/v3/users => generated 311 bytes in 658 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:25.556093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:25.559098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:25.603074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8900-1d3b-44f2-84f8-3a1f7162ccf1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:25.615060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:25.618063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:25.618291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:25.623318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:25.625884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:25.641263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:25.650160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4220d453af04b9f85074a5431f841b4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.651451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4220d453af04b9f85074a5431f841b4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.675559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4220d453af04b9f85074a5431f841b4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.676023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 909/1810] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:25.676634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4220d453af04b9f85074a5431f841b4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.680781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:25.686130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:25.695125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4220d453af04b9f85074a5431f841b4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:25.719511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 902/1811] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:25 2022] DELETE /identity/v3/users/b4220d453af04b9f85074a5431f841b4 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:25.739357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d808-1df5-4100-a2c2-95a4cd0df99c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:25.943785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:25.952427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:25.955781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:25.956079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] PATH_INFO: `/v3/projects/e041cdc182c2483ebb7038fd5d83e1d9/users/87e63d42f3a3488c80a91060d62dccb8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:26.009089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e041cdc182c2483ebb7038fd5d83e1d9, user_id=87e63d42f3a3488c80a91060d62dccb8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:26.020969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:26.064036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 910/1812] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:25 2022] PUT /identity/v3/projects/e041cdc182c2483ebb7038fd5d83e1d9/users/87e63d42f3a3488c80a91060d62dccb8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:26.065647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:26.081504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1863c-d780-4d19-8d36-3b216877775e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:26.226221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444a2ae-f1b4-4b0a-937a-6a33587a1f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:26.229715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444a2ae-f1b4-4b0a-937a-6a33587a1f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:26.230111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444a2ae-f1b4-4b0a-937a-6a33587a1f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:26.230581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444a2ae-f1b4-4b0a-937a-6a33587a1f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:26.231860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444a2ae-f1b4-4b0a-937a-6a33587a1f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:26.236337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444a2ae-f1b4-4b0a-937a-6a33587a1f00 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:26.261133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 903/1813] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:26.265601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:26.285693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0703faa-6320-4c71-bc80-c69f1115d622 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:26.302996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:26.305048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:26.305048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:26.305608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] PATH_INFO: `/v3/projects/e041cdc182c2483ebb7038fd5d83e1d9/users/87e63d42f3a3488c80a91060d62dccb8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:26.308167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e041cdc182c2483ebb7038fd5d83e1d9, user_id=87e63d42f3a3488c80a91060d62dccb8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:26.320021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:26.357271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 911/1814] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:26 2022] PUT /identity/v3/projects/e041cdc182c2483ebb7038fd5d83e1d9/users/87e63d42f3a3488c80a91060d62dccb8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:26.369006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:26.369441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:26.369838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:26.451491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] MFA Rules not processed for user `87e63d42f3a3488c80a91060d62dccb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:26.452928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:26.661923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:26.708379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 904/1815] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:26.722271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:26.725170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:26.935433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec0607-eb69-45df-b04a-c10039902f07 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:26.963333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:26.964123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:26.969498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:26.971078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:26.995447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:26.998071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:27.016727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 912/1816] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:27.518136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:27.519506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:27.573093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acdbcc-4f40-450a-8194-e28ee46eea14 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:27.591860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450bf7e-2964-4344-985a-a1401c89f369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:27.594005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bf7e-2964-4344-985a-a1401c89f369 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:27.595076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bf7e-2964-4344-985a-a1401c89f369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:27.595376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bf7e-2964-4344-985a-a1401c89f369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:27.600700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f450bf7e-2964-4344-985a-a1401c89f369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:27.859511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450bf7e-2964-4344-985a-a1401c89f369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:27.861064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450bf7e-2964-4344-985a-a1401c89f369 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:27.916856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 905/1817] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:28.207208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:28.208649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:28.217250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:28.491903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463adcb3-0b3d-45f4-95bc-e2c345b25612 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:28.516046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:28.516727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:28.517010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:28.517285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] PATH_INFO: `/v3/users/27893f2e7fc7422fa309dacbc1c3bf65` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:28.518629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27893f2e7fc7422fa309dacbc1c3bf65)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:28.523606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:28.629797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27893f2e7fc7422fa309dacbc1c3bf65'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:28.630506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27893f2e7fc7422fa309dacbc1c3bf65'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:28.646109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27893f2e7fc7422fa309dacbc1c3bf65'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:28.665471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27893f2e7fc7422fa309dacbc1c3bf65'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:28.697690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27893f2e7fc7422fa309dacbc1c3bf65'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:28.720536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 913/1818] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:28 2022] DELETE /identity/v3/users/27893f2e7fc7422fa309dacbc1c3bf65 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:28.723081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b6b3-ab49-4fc9-a985-11e6f2c8a0aa None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:28.723703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b6b3-ab49-4fc9-a985-11e6f2c8a0aa None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:28.723819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b6b3-ab49-4fc9-a985-11e6f2c8a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:28.801730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-aca9b6b3-ab49-4fc9-a985-11e6f2c8a0aa None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:28.815427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-aca9b6b3-ab49-4fc9-a985-11e6f2c8a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:29.083439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 906/1819] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:29.251255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:29.253560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:29.254720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221592f-76f0-4cfb-878c-7601c912d71a None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:29.255007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221592f-76f0-4cfb-878c-7601c912d71a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:29.255387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221592f-76f0-4cfb-878c-7601c912d71a None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:29.257498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 907/1820] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:16:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:16:29.441235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221592f-76f0-4cfb-878c-7601c912d71a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:29.449334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2221592f-76f0-4cfb-878c-7601c912d71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:29.459159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aa981-48cc-41bd-8db1-60874970dd12 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:29.469984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1c21-4e76-4d86-92d9-55fec103f173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:29.470839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1c21-4e76-4d86-92d9-55fec103f173 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:29.471497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1c21-4e76-4d86-92d9-55fec103f173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:29.471497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1c21-4e76-4d86-92d9-55fec103f173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:29.495178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221592f-76f0-4cfb-878c-7601c912d71a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:29.495632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d1c21-4e76-4d86-92d9-55fec103f173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:29.497215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d1c21-4e76-4d86-92d9-55fec103f173 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:29.502276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:29.503188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:29.503469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:29.503789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] PATH_INFO: `/v3/projects/5b970efece504b1fa0fc46883c2a6eba` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:29.505067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b970efece504b1fa0fc46883c2a6eba)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:29.507304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:29.539843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 914/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:29.541390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab4f1-28e9-40da-862a-3044242682d5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:29.544347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab4f1-28e9-40da-862a-3044242682d5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:29.544861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab4f1-28e9-40da-862a-3044242682d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:29.610063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f7fab4f1-28e9-40da-862a-3044242682d5 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:29.629654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f7fab4f1-28e9-40da-862a-3044242682d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:29.697890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:29.765059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b970efece504b1fa0fc46883c2a6eba', 'request_id': 'req-19d5e152-eb26-4d28-9c51-e823dce0706e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:29.786503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b970efece504b1fa0fc46883c2a6eba', 'request_id': 'req-19d5e152-eb26-4d28-9c51-e823dce0706e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:29.801752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b970efece504b1fa0fc46883c2a6eba', 'request_id': 'req-19d5e152-eb26-4d28-9c51-e823dce0706e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:29.840704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] The token cache is being invalidate because project 5b970efece504b1fa0fc46883c2a6eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:29.842516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:29.844174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:29.847478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 908/1822] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:29 2022] DELETE /identity/v3/projects/5b970efece504b1fa0fc46883c2a6eba => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:29.851277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:29.853131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:29.864506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 915/1823] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:16:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:29.923755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:30.124060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc1ff9-19e0-4c70-bde7-3fe456b00ff0 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:30.124442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc1ff9-19e0-4c70-bde7-3fe456b00ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:30.124867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc1ff9-19e0-4c70-bde7-3fe456b00ff0 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:30.126404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 916/1824] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:16:30.127699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5e152-eb26-4d28-9c51-e823dce0706e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:30.158736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:30.159468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:30.159757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:30.160099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] PATH_INFO: `/v3/users/c14744ba5e68488aa0e18fe2bca9ca7d` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:30.165472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14744ba5e68488aa0e18fe2bca9ca7d)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:30.177541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:30.360251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14744ba5e68488aa0e18fe2bca9ca7d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:30.361581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14744ba5e68488aa0e18fe2bca9ca7d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:30.390606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14744ba5e68488aa0e18fe2bca9ca7d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:30.400652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14744ba5e68488aa0e18fe2bca9ca7d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:30.459377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14744ba5e68488aa0e18fe2bca9ca7d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:30.482033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 909/1825] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:29 2022] DELETE /identity/v3/users/c14744ba5e68488aa0e18fe2bca9ca7d => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:30.827472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:30.828301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:30.829009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:30.899386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:30.900522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:31.029499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:31.031607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:31.099261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 917/1826] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:16:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:31.234886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c73ed-0774-4fbb-9a41-3096ffed50f6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:31.243350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:31.251494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:31.251855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:31.252220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:31.273921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:31.329787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:31.333127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:31.356836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 910/1827] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:31.443991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:31.448579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:31.556548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:31.573162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538d2b-d6d0-4885-b880-12e34bad8eb3 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:31.608346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540073cc-8b22-403e-bfa2-fba76e8df28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:31.609466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540073cc-8b22-403e-bfa2-fba76e8df28e service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:31.610439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540073cc-8b22-403e-bfa2-fba76e8df28e service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:31.612418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540073cc-8b22-403e-bfa2-fba76e8df28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:31.639072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540073cc-8b22-403e-bfa2-fba76e8df28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:31.641737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540073cc-8b22-403e-bfa2-fba76e8df28e service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:31.653666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c4eb0-92b1-42ab-803b-654230aefe3b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:31.661844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:31.662058 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:31.662156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:31.662463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] PATH_INFO: `/v3/projects/8e4f19f05183482a9bbf74777376a409` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:31.664029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4f19f05183482a9bbf74777376a409)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:31.665976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:31.677482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 911/1828] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:31.804846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4f19f05183482a9bbf74777376a409', 'request_id': 'req-304e521d-f4a5-4691-ba30-e9ed652881e3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:31.808975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:31.821844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4f19f05183482a9bbf74777376a409', 'request_id': 'req-304e521d-f4a5-4691-ba30-e9ed652881e3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:31.835466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4f19f05183482a9bbf74777376a409', 'request_id': 'req-304e521d-f4a5-4691-ba30-e9ed652881e3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:31.860214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] The token cache is being invalidate because project 8e4f19f05183482a9bbf74777376a409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:31.860731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:31.871177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-304e521d-f4a5-4691-ba30-e9ed652881e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:31.881731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 918/1829] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:31 2022] DELETE /identity/v3/projects/8e4f19f05183482a9bbf74777376a409 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:31.887149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146abb-c41a-482e-8f55-5d9d15e064f3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:31.887463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146abb-c41a-482e-8f55-5d9d15e064f3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:31.887808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146abb-c41a-482e-8f55-5d9d15e064f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:31.902991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:31.924457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3b146abb-c41a-482e-8f55-5d9d15e064f3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:31.925738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3b146abb-c41a-482e-8f55-5d9d15e064f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:32.055169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 912/1830] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:32.062437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43381-da20-4866-a191-83c8eb9ffc44 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.062734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43381-da20-4866-a191-83c8eb9ffc44 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.063006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43381-da20-4866-a191-83c8eb9ffc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.132640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-24a43381-da20-4866-a191-83c8eb9ffc44 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:32.133910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-24a43381-da20-4866-a191-83c8eb9ffc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:32.157292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b146abb-c41a-482e-8f55-5d9d15e064f3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.157389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 919/1831] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:32.167413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b146abb-c41a-482e-8f55-5d9d15e064f3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.190725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.190725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.190725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.190725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.191156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:32.191156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.192207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.221591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 913/1832] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:32.226196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43381-da20-4866-a191-83c8eb9ffc44 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.250387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43381-da20-4866-a191-83c8eb9ffc44 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.284016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.286290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.287120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.288863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.291642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.299076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.355777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 920/1833] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:32 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:32.357016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.374713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3151d-2957-4de6-a8df-5f3d388d87f3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.470330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.478814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.479242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:32.479511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.479798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.481132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.482541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.485325 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.503001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5967-b35e-47bd-8377-1cb910430b2c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.510141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.511266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.512209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.512610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] PATH_INFO: `/v3/projects/c1ef6702a3f548e8af3a554e96094c97` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.524847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ef6702a3f548e8af3a554e96094c97)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.525403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 914/1834] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:32 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:32.529408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.531152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.543791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591320-01ce-4f45-8590-a0078230bd30 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.550661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.551679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.552260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.552823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.553864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.556414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.574809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 915/1835] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:32.576081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.587375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28861216-f283-432e-8506-ed260eff4dc0 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.593082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.594388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.594388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.594784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.595645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.597267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.614555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 916/1836] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:32.618889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.631701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ef6702a3f548e8af3a554e96094c97', 'request_id': 'req-eb9cca45-bb62-436b-889e-9280a28b47d9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.636957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71a5b0-69e9-4076-8194-6279034fa3a9 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.643571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ef6702a3f548e8af3a554e96094c97', 'request_id': 'req-eb9cca45-bb62-436b-889e-9280a28b47d9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.651179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ef6702a3f548e8af3a554e96094c97', 'request_id': 'req-eb9cca45-bb62-436b-889e-9280a28b47d9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.664669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] The token cache is being invalidate because project c1ef6702a3f548e8af3a554e96094c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:32.664957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.665636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.671052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 921/1837] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:32 2022] DELETE /identity/v3/projects/c1ef6702a3f548e8af3a554e96094c97 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:32.672750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.676561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:32.716962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:32.728643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.729489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.730769 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.731053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] PATH_INFO: `/v3/projects/bfff38f2f0c447028c1b124c49f81ef2/users/a7ee5c13eee145f7b89ae3074516895a/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.757346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfff38f2f0c447028c1b124c49f81ef2, user_id=a7ee5c13eee145f7b89ae3074516895a, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.760802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.792352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 917/1838] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:32 2022] PUT /identity/v3/projects/bfff38f2f0c447028c1b124c49f81ef2/users/a7ee5c13eee145f7b89ae3074516895a/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:32.794442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:32.804068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:32.818676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cca45-bb62-436b-889e-9280a28b47d9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.868749 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:32.881881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57cfaa-ee16-4d56-a8a2-6be448909413 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:32.887086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.887872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.888275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.888651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] PATH_INFO: `/v3/projects/d248c8261ca947ee8fea5bcd0893822c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.889911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d248c8261ca947ee8fea5bcd0893822c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.890790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:32.891447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.891756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.892006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] PATH_INFO: `/v3/users/4bcc78e363854a1e96a646ee781bf9a1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.892384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.893614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bcc78e363854a1e96a646ee781bf9a1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:32.895761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:32.950670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcc78e363854a1e96a646ee781bf9a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.951879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcc78e363854a1e96a646ee781bf9a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.953407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd248c8261ca947ee8fea5bcd0893822c', 'request_id': 'req-7652e0cf-a38c-4dbb-a06e-e30754d946c6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.961268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd248c8261ca947ee8fea5bcd0893822c', 'request_id': 'req-7652e0cf-a38c-4dbb-a06e-e30754d946c6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.961562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcc78e363854a1e96a646ee781bf9a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.968941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd248c8261ca947ee8fea5bcd0893822c', 'request_id': 'req-7652e0cf-a38c-4dbb-a06e-e30754d946c6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.972126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcc78e363854a1e96a646ee781bf9a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.986034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-af1a7ae7-4b9e-4918-bc96-0f704fc7528c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcc78e363854a1e96a646ee781bf9a1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.986455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] The token cache is being invalidate because project d248c8261ca947ee8fea5bcd0893822c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:32.986796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.987657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7652e0cf-a38c-4dbb-a06e-e30754d946c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:32.989500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 918/1839] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:32 2022] DELETE /identity/v3/projects/d248c8261ca947ee8fea5bcd0893822c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:32.991322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.991634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.992010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:32.995884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 922/1840] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:32 2022] DELETE /identity/v3/users/4bcc78e363854a1e96a646ee781bf9a1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:32.997225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326368-4d01-40b9-8c07-0266b24dd5cd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:32.997522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326368-4d01-40b9-8c07-0266b24dd5cd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:32.997797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326368-4d01-40b9-8c07-0266b24dd5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.026344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8e326368-4d01-40b9-8c07-0266b24dd5cd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:33.027305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] MFA Rules not processed for user `a7ee5c13eee145f7b89ae3074516895a`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:33.028263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8e326368-4d01-40b9-8c07-0266b24dd5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:33.029237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:33.102067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:33.107703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 919/1841] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:33.108545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 923/1842] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:33.123396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.124552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fa99-348e-4e56-8ba5-78e807ec8557 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.125138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:33.125333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fa99-348e-4e56-8ba5-78e807ec8557 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.125612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fa99-348e-4e56-8ba5-78e807ec8557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.146052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8bf0d-9c52-4196-990c-b651bc3d881d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.154318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.155086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.155464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.156087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.157482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.159649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.165220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cee7fa99-348e-4e56-8ba5-78e807ec8557 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:33.166495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cee7fa99-348e-4e56-8ba5-78e807ec8557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:33.176419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 924/1843] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:33.181360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fa99-348e-4e56-8ba5-78e807ec8557 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.192162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fa99-348e-4e56-8ba5-78e807ec8557 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.192415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 920/1844] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:33 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:33.196412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.285760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:33.286031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee9ab3-69b8-4a13-9132-2487f08b39eb admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.291765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.293180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.293458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.293878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.294885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.297197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.302316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.303833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.304248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.304693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.305548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:33.333758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.337231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 921/1845] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:33 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:33.339279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.341614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.364971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f815b-375a-4667-8ab8-45c1b041b78c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.373194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.374361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.374742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.375173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.376020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.377708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.378308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 925/1846] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:33.382993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.393600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 922/1847] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:33.398401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.404832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8758-eaeb-452d-b7de-be801a325288 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.416525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.417120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8552a20-0287-460e-ad1d-8bbcec7443f2 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.417236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.418382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.419089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.419338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.425353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.425666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.427493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.428385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.428867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] PATH_INFO: `/v3/projects/7dac3e3a37044100b42521405999e452/users/fb80779ccaa74e30a930e1028e581d97/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.484651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dac3e3a37044100b42521405999e452, user_id=fb80779ccaa74e30a930e1028e581d97, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.492828 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.519304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 926/1848] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:33 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:33.524528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.551551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 923/1849] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:33 2022] PUT /identity/v3/projects/7dac3e3a37044100b42521405999e452/users/fb80779ccaa74e30a930e1028e581d97/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:33.556013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.669526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0181ca-fbbd-48fe-a678-144bf2942eac admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.728585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d19b-a3e3-40a3-8889-558196a91e12 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.739238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.740082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.740520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.741440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.742221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.744057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.764733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 924/1850] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:33.768770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.780844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b865f-2eb7-45e8-8c16-ab51c519143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.781676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b865f-2eb7-45e8-8c16-ab51c519143e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.781958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b865f-2eb7-45e8-8c16-ab51c519143e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.782313 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b865f-2eb7-45e8-8c16-ab51c519143e admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.784135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b865f-2eb7-45e8-8c16-ab51c519143e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.786540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b865f-2eb7-45e8-8c16-ab51c519143e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.788442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b846a91-eab5-4837-acef-a75ad40bb4f6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.795585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.796747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.797139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.800688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] PATH_INFO: `/v3/projects/7dac3e3a37044100b42521405999e452/users/fb80779ccaa74e30a930e1028e581d97/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.803787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dac3e3a37044100b42521405999e452, user_id=fb80779ccaa74e30a930e1028e581d97, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.807707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.821625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 925/1851] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:33 2022] PUT /identity/v3/projects/7dac3e3a37044100b42521405999e452/users/fb80779ccaa74e30a930e1028e581d97/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:33.824792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 927/1852] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:33 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:33.831780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.832754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c540ae-7a64-41be-95ef-7587bddc7683 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.833045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c540ae-7a64-41be-95ef-7587bddc7683 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.833325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c540ae-7a64-41be-95ef-7587bddc7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.862159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:33.893293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a5c540ae-7a64-41be-95ef-7587bddc7683 None None] MFA Rules not processed for user `fb80779ccaa74e30a930e1028e581d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:33.895208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a5c540ae-7a64-41be-95ef-7587bddc7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:33.953021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8cf90-6321-42f4-992b-dc7053f7ad28 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:33.960287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:33.961511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:33.961840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:33.962218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:33.963437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:33.965272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:33.990664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 926/1853] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:16:33.991424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:33.993227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.007656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:34.019771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c652-1617-47f8-bae1-ebc0345c1199 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.028718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.029386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.029666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.029938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] PATH_INFO: `/v3/projects/ef85d8af73db4619a22e6467efd44956` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.031227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef85d8af73db4619a22e6467efd44956)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.033145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.068545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 928/1854] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:34.069569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c540ae-7a64-41be-95ef-7587bddc7683 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.090604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c540ae-7a64-41be-95ef-7587bddc7683 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.095816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef85d8af73db4619a22e6467efd44956', 'request_id': 'req-86779a28-d02f-4315-ba59-4b3ddd213ef2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.103277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef85d8af73db4619a22e6467efd44956', 'request_id': 'req-86779a28-d02f-4315-ba59-4b3ddd213ef2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.110494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef85d8af73db4619a22e6467efd44956', 'request_id': 'req-86779a28-d02f-4315-ba59-4b3ddd213ef2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.139999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] The token cache is being invalidate because project ef85d8af73db4619a22e6467efd44956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:34.140634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.142413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.144236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 927/1855] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:33 2022] DELETE /identity/v3/projects/ef85d8af73db4619a22e6467efd44956 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:34.145968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.148965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.183183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7a0a-28af-4e99-ba58-0b2aae4b9800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.183822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7a0a-28af-4e99-ba58-0b2aae4b9800 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.184159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7a0a-28af-4e99-ba58-0b2aae4b9800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.184432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7a0a-28af-4e99-ba58-0b2aae4b9800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.185141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7a0a-28af-4e99-ba58-0b2aae4b9800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.186963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7a0a-28af-4e99-ba58-0b2aae4b9800 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.205296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 929/1856] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:34.205296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.205296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.206118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.231632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86779a28-d02f-4315-ba59-4b3ddd213ef2 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.234738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:34.235929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.240781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eafb9a-9105-4fe3-afd2-1581654a8927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.241704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eafb9a-9105-4fe3-afd2-1581654a8927 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.242185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eafb9a-9105-4fe3-afd2-1581654a8927 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.242673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eafb9a-9105-4fe3-afd2-1581654a8927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.245419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 930/1857] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:34.246066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.251410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.253337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-66eafb9a-9105-4fe3-afd2-1581654a8927 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.265397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c22744-def2-445e-8220-71c9b87484d2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.270720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3423c-5dcf-461d-bbda-1d4eb9b4ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.271404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3423c-5dcf-461d-bbda-1d4eb9b4ce32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.271679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3423c-5dcf-461d-bbda-1d4eb9b4ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.271951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3423c-5dcf-461d-bbda-1d4eb9b4ce32 admin admin] PATH_INFO: `/v3/projects/4527e74db258421b8dfacebc412db6c9/users/3068189449864d479ccd202472ea8da0/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.291014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3423c-5dcf-461d-bbda-1d4eb9b4ce32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4527e74db258421b8dfacebc412db6c9, user_id=3068189449864d479ccd202472ea8da0, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.293901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3423c-5dcf-461d-bbda-1d4eb9b4ce32 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.308685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:34.311469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 931/1858] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:34 2022] PUT /identity/v3/projects/4527e74db258421b8dfacebc412db6c9/users/3068189449864d479ccd202472ea8da0/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:34.314345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.314345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.314345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.332482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eafb9a-9105-4fe3-afd2-1581654a8927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.333998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eafb9a-9105-4fe3-afd2-1581654a8927 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.341730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:34.343674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.346841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 928/1859] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:34.348358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda3f7-8882-4641-ab58-df4bad2048f6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.348703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda3f7-8882-4641-ab58-df4bad2048f6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.348988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda3f7-8882-4641-ab58-df4bad2048f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.391261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f9eda3f7-8882-4641-ab58-df4bad2048f6 None None] MFA Rules not processed for user `3068189449864d479ccd202472ea8da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:34.392726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f9eda3f7-8882-4641-ab58-df4bad2048f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.425738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 932/1860] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:34.427025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.428414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.444817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430eb06-54b9-4017-844f-08abd0c31685 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.451333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.452031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.452253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.452531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] PATH_INFO: `/v3/users/a7ee5c13eee145f7b89ae3074516895a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.454286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ee5c13eee145f7b89ae3074516895a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.456170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.474639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 929/1861] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:34.479063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eda3f7-8882-4641-ab58-df4bad2048f6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.497994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eda3f7-8882-4641-ab58-df4bad2048f6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.505896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.508734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.510032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.510790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.513040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:34.514555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.517959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.558773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ee5c13eee145f7b89ae3074516895a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.559341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ee5c13eee145f7b89ae3074516895a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.559770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 930/1862] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:34.560989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.563474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:34.581532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ee5c13eee145f7b89ae3074516895a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.584373 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a642e-b1cd-4d7c-86ef-e674eed2e75c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.590596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.591533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.591817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.592161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.593128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.596768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.597756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ee5c13eee145f7b89ae3074516895a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.640416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-95e610fc-5309-4c13-9b54-a14ce407f12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ee5c13eee145f7b89ae3074516895a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:34.657297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 931/1864] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:34.658155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 933/1864] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:34 2022] DELETE /identity/v3/users/a7ee5c13eee145f7b89ae3074516895a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:34.661074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.661222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e830-04f7-4d62-9e3d-f870db483839 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.661404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e830-04f7-4d62-9e3d-f870db483839 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.661666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e830-04f7-4d62-9e3d-f870db483839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.664172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.720735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ef70e830-04f7-4d62-9e3d-f870db483839 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:34.726371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ef70e830-04f7-4d62-9e3d-f870db483839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.822931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bdcf7-f354-402c-944d-9c1a512278a8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:34.832520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:34.835532 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:34.835825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:34.837135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:34.837824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:34.843949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:34.906954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 932/1865] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:34.906954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.915858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:34.916688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 934/1866] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:34.919037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e830-04f7-4d62-9e3d-f870db483839 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:34.935501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e830-04f7-4d62-9e3d-f870db483839 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.003408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:35.061275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.061872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.062178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.062630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.063292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.071253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.082153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051f2c-90b6-46c9-af35-4c5c7fd4e864 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.094225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.095221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.098114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.100797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.104240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.110114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.116766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 935/1867] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:35.116766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.124981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:35.159990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 933/1868] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:34 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:35.159990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.163241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:35.184421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aef88f-af3d-4ab3-b023-bf1cdd50637e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.193992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.194877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.195275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.195618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] PATH_INFO: `/v3/users/7725fc3c36c944c4b677500e2517820c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.197760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7725fc3c36c944c4b677500e2517820c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.200391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.265929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef6c74-28e9-4b05-bfaa-499d5b5ba15f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.279208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.279864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.280144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.280418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.289370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7725fc3c36c944c4b677500e2517820c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:35.290916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7725fc3c36c944c4b677500e2517820c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:35.301870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.306407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.319362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 936/1869] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:35.321443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.328011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7725fc3c36c944c4b677500e2517820c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:35.328842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7725fc3c36c944c4b677500e2517820c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:35.330271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:35.338006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a845f1-f0ee-486f-b125-1395e0423f0e service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.350469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.351169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.351450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.351720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.353589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.373612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.376379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7725fc3c36c944c4b677500e2517820c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:35.394349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 937/1870] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:35.403380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.405336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 934/1871] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:35 2022] DELETE /identity/v3/users/7725fc3c36c944c4b677500e2517820c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:35.406216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.407640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:35.410200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:35.436483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1484583-7433-4f8d-a2e9-0b3cc6ada229 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.591386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d806e-dfb5-4df8-a97d-07b9644bca60 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.604087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626d062-dcde-405e-ad86-35eca89ff9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.606083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626d062-dcde-405e-ad86-35eca89ff9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.606456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626d062-dcde-405e-ad86-35eca89ff9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.606868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626d062-dcde-405e-ad86-35eca89ff9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.607605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.608557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626d062-dcde-405e-ad86-35eca89ff9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.609420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.611277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626d062-dcde-405e-ad86-35eca89ff9ba admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.611857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.612028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.612917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.619721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.643135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 935/1872] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:35.649714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe54ae-c62c-4e90-aed3-5603c9bd47d4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.650035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe54ae-c62c-4e90-aed3-5603c9bd47d4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.650334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe54ae-c62c-4e90-aed3-5603c9bd47d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.652111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 938/1873] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:35.652739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.671070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec55b-2a6f-4f48-b771-f4e5764d80fd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.677017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.689375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-eabe54ae-c62c-4e90-aed3-5603c9bd47d4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:35.691277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.691866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-eabe54ae-c62c-4e90-aed3-5603c9bd47d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:35.693555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.695576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] PATH_INFO: `/v3/projects/05720ed93cb049f99c5e5c37d9faeb75/users/a68c15a8b34f496392043d7a27658c09/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.702195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 936/1874] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:35.703219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe54ae-c62c-4e90-aed3-5603c9bd47d4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.721067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe54ae-c62c-4e90-aed3-5603c9bd47d4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.721891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05720ed93cb049f99c5e5c37d9faeb75, user_id=a68c15a8b34f496392043d7a27658c09, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.725061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.726384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c1be3-9b1c-46b9-9b18-a9d60f55c920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.727158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1be3-9b1c-46b9-9b18-a9d60f55c920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.727504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1be3-9b1c-46b9-9b18-a9d60f55c920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.727851 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1be3-9b1c-46b9-9b18-a9d60f55c920 admin admin] PATH_INFO: `/v3/projects/200ac7c6876141968385cbce4cd50682/users/74f58f4556e7496dbdda9dbae9ecbfd1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.744758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:35.747409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 939/1875] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:35 2022] PUT /identity/v3/projects/05720ed93cb049f99c5e5c37d9faeb75/users/a68c15a8b34f496392043d7a27658c09/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:35.756693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.757968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c1be3-9b1c-46b9-9b18-a9d60f55c920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200ac7c6876141968385cbce4cd50682, user_id=74f58f4556e7496dbdda9dbae9ecbfd1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.760405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:35.764019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c1be3-9b1c-46b9-9b18-a9d60f55c920 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:35.782893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 937/1876] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:35 2022] PUT /identity/v3/projects/200ac7c6876141968385cbce4cd50682/users/74f58f4556e7496dbdda9dbae9ecbfd1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:35.784573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3920a2-a396-4f4f-a908-987bf38e6692 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.785115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3920a2-a396-4f4f-a908-987bf38e6692 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.785395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3920a2-a396-4f4f-a908-987bf38e6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.818321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-0b3920a2-a396-4f4f-a908-987bf38e6692 None None] MFA Rules not processed for user `a68c15a8b34f496392043d7a27658c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:35.819488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0b3920a2-a396-4f4f-a908-987bf38e6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:35.838965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0bdf-ee0f-41f8-8f17-34a3f4d1a1e1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.905418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 938/1877] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:35.906629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3920a2-a396-4f4f-a908-987bf38e6692 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:35.937569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.938505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.938894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.939269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.983562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:35.984817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3920a2-a396-4f4f-a908-987bf38e6692 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:35.991830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:35.992697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:35.993020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:35.993716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:35.994453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:35.996265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.007960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 939/1878] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:36.008611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.018432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d44d2-116d-4f0c-8ad5-20d1f28dc6ca admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.021087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.022681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.023507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.024206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.024722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.025076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.026417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.029192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.034120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 940/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:36.039412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.052302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244aaa4-36fd-4954-a144-d9655e3e86eb service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.058863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cc3ce-4f19-4c0e-8a00-3276dc96ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.060787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc3ce-4f19-4c0e-8a00-3276dc96ec4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.061183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc3ce-4f19-4c0e-8a00-3276dc96ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.061980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc3ce-4f19-4c0e-8a00-3276dc96ec4a admin admin] PATH_INFO: `/v3/projects/200ac7c6876141968385cbce4cd50682/users/74f58f4556e7496dbdda9dbae9ecbfd1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.064786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cc3ce-4f19-4c0e-8a00-3276dc96ec4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=200ac7c6876141968385cbce4cd50682, user_id=74f58f4556e7496dbdda9dbae9ecbfd1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.069486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cc3ce-4f19-4c0e-8a00-3276dc96ec4a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.083284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 940/1880] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:36 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:36.097925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 941/1881] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:36 2022] PUT /identity/v3/projects/200ac7c6876141968385cbce4cd50682/users/74f58f4556e7496dbdda9dbae9ecbfd1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:36.098100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.124370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147064-ce47-4247-be51-855dc9e9f18a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.124832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147064-ce47-4247-be51-855dc9e9f18a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.125746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43147064-ce47-4247-be51-855dc9e9f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.181491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-43147064-ce47-4247-be51-855dc9e9f18a None None] MFA Rules not processed for user `74f58f4556e7496dbdda9dbae9ecbfd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:36.183328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-43147064-ce47-4247-be51-855dc9e9f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:36.215657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:36.230905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528df78-8fd3-4a51-be9c-03ceb73d16e3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.247839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.248797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.249441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.249957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.250715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.253269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.282295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 941/1882] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:36 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:36.283159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.286054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:36.297968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 942/1883] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:36.298744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43147064-ce47-4247-be51-855dc9e9f18a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.299509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b834f-5b05-4f4c-a179-f9d530cc4b8e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.305941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.306670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.307015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.307581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] PATH_INFO: `/v3/projects/bfff38f2f0c447028c1b124c49f81ef2` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.308720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfff38f2f0c447028c1b124c49f81ef2)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.317487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43147064-ce47-4247-be51-855dc9e9f18a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.321298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.328750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.329573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.329982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.330521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.331672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.333650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.358850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 943/1884] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:36.360272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.361865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:36.404727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfff38f2f0c447028c1b124c49f81ef2', 'request_id': 'req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.427852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfff38f2f0c447028c1b124c49f81ef2', 'request_id': 'req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.447778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfff38f2f0c447028c1b124c49f81ef2', 'request_id': 'req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.467652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] The token cache is being invalidate because project bfff38f2f0c447028c1b124c49f81ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:36.468530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.469360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.471675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 942/1885] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:36 2022] DELETE /identity/v3/projects/bfff38f2f0c447028c1b124c49f81ef2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:36.474729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.474884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:36.500378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59e05b-2a71-4b76-b3af-8fff88ab545b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.596778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e9d0e-63fe-40cc-8d9a-57ae78319e2c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.608216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.608906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.611050 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.611334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] PATH_INFO: `/v3/projects/4923bef93e8740199816a14cfac5a680/users/3c920668eba24f0fb8bdff9688a8f965/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.634591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:36.640618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4923bef93e8740199816a14cfac5a680, user_id=3c920668eba24f0fb8bdff9688a8f965, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.644217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.650915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.651756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.652525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.652720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.655269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:36.670070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 943/1886] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:36 2022] PUT /identity/v3/projects/4923bef93e8740199816a14cfac5a680/users/3c920668eba24f0fb8bdff9688a8f965/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:36.682571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.684626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:36.748959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.751318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.767568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:36.768695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 944/1887] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:36.769597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.784683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dfb9-bf8e-4687-a635-169cf0f35f69 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.790952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.791713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.791944 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.792760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.793692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.795575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.796377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276fa2a-540f-4e17-b5dc-9fbec4953ccd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.804717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.805480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.805831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.806291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] PATH_INFO: `/v3/users/fb80779ccaa74e30a930e1028e581d97` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.807730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb80779ccaa74e30a930e1028e581d97)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.810864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.822412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 945/1888] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:36.826363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.845824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cdb13-816d-47d2-bc9a-e29591b833f0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:36.853274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:36.857191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.857883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.858711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] PATH_INFO: `/v3/projects/4923bef93e8740199816a14cfac5a680/users/3c920668eba24f0fb8bdff9688a8f965/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.863093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4923bef93e8740199816a14cfac5a680, user_id=3c920668eba24f0fb8bdff9688a8f965, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:36.871659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:36.902093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb80779ccaa74e30a930e1028e581d97'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.903119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb80779ccaa74e30a930e1028e581d97'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.908566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 946/1889] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:36 2022] PUT /identity/v3/projects/4923bef93e8740199816a14cfac5a680/users/3c920668eba24f0fb8bdff9688a8f965/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:36.911280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:36.916004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:36.924863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb80779ccaa74e30a930e1028e581d97'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.925591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb80779ccaa74e30a930e1028e581d97'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.941471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f5ece3ca-225a-486d-82a4-edd48d804f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb80779ccaa74e30a930e1028e581d97'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:36.956537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 944/1890] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:36 2022] DELETE /identity/v3/users/fb80779ccaa74e30a930e1028e581d97 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:36.957829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:36.958121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:36.958431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:36.991220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] MFA Rules not processed for user `3c920668eba24f0fb8bdff9688a8f965`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:36.992431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.002659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04efc2-902d-4987-8cb1-2de67a3ae462 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:37.074598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 945/1891] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:37.075155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:37.075755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:37.076107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.076620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.076951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] PATH_INFO: `/v3/projects/fc09fa16f0594e93b67ad34229998d8c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.077999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.079023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc09fa16f0594e93b67ad34229998d8c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:37.081355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:37.115121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:37.164549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc09fa16f0594e93b67ad34229998d8c', 'request_id': 'req-138db372-19aa-4744-8240-db6ec943e7b5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.177620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc09fa16f0594e93b67ad34229998d8c', 'request_id': 'req-138db372-19aa-4744-8240-db6ec943e7b5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.179933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e722-f11d-4de1-88d2-5be0903e87a3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:37.189869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc09fa16f0594e93b67ad34229998d8c', 'request_id': 'req-138db372-19aa-4744-8240-db6ec943e7b5'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.199364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:37.211051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] The token cache is being invalidate because project fc09fa16f0594e93b67ad34229998d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:37.211353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.212255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.214127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 947/1892] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:36 2022] DELETE /identity/v3/projects/fc09fa16f0594e93b67ad34229998d8c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:37.215277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:37.217001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.258677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:37.259310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.259588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.259859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.262403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.281103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138db372-19aa-4744-8240-db6ec943e7b5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:37.285805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:37.286780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.287259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.287633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.289985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.374689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:37.376696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:37.381928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:37.385260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:37.388500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 948/1893] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:37.389136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:37.390512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.398959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 946/1894] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:37.413082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:37.414782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.470192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:37.494382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d37f0-bd6a-48dd-ac04-50ee9f3e1beb service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:37.503405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:37.504276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.504771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.505230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] PATH_INFO: `/v3/users/87e63d42f3a3488c80a91060d62dccb8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.506917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e63d42f3a3488c80a91060d62dccb8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:37.509760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:37.522252 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183f64b-cb87-40f9-a9b2-2d2b77f6282e service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:37.529759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:37.530452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.530739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.531590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] PATH_INFO: `/v3/projects/7dac3e3a37044100b42521405999e452` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.534905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dac3e3a37044100b42521405999e452)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:37.537098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:37.575063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e63d42f3a3488c80a91060d62dccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.575940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e63d42f3a3488c80a91060d62dccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.585116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e63d42f3a3488c80a91060d62dccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.599151 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e63d42f3a3488c80a91060d62dccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.610809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dac3e3a37044100b42521405999e452', 'request_id': 'req-6b598602-14c7-46ff-aee3-24bf5732cc77'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.614834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e63d42f3a3488c80a91060d62dccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.617969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dac3e3a37044100b42521405999e452', 'request_id': 'req-6b598602-14c7-46ff-aee3-24bf5732cc77'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.624764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 949/1895] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:37 2022] DELETE /identity/v3/users/87e63d42f3a3488c80a91060d62dccb8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:37.624764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:37.624764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.635486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dac3e3a37044100b42521405999e452', 'request_id': 'req-6b598602-14c7-46ff-aee3-24bf5732cc77'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.640641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:37.658845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] The token cache is being invalidate because project 7dac3e3a37044100b42521405999e452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:37.659332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.664666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6b598602-14c7-46ff-aee3-24bf5732cc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.668095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 947/1896] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:37 2022] DELETE /identity/v3/projects/7dac3e3a37044100b42521405999e452 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:37.672902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f926-4a64-4736-be22-44a43ce2ee6f None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.673246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f926-4a64-4736-be22-44a43ce2ee6f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.673559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f926-4a64-4736-be22-44a43ce2ee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.708447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7713f926-4a64-4736-be22-44a43ce2ee6f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:37.710294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7713f926-4a64-4736-be22-44a43ce2ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.739645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63b68c-380c-4b90-8f27-bf6c06e836ef admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:37.750370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:37.751472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.751472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.751771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] PATH_INFO: `/v3/users/a68c15a8b34f496392043d7a27658c09` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.753448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68c15a8b34f496392043d7a27658c09)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:37.755488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:37.838536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 948/1897] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:37.838536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211654-3f9b-45c4-9021-931ed74e48f7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.838536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211654-3f9b-45c4-9021-931ed74e48f7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.838536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211654-3f9b-45c4-9021-931ed74e48f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.864078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68c15a8b34f496392043d7a27658c09'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.864972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68c15a8b34f496392043d7a27658c09'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.877556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68c15a8b34f496392043d7a27658c09'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.882720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-09211654-3f9b-45c4-9021-931ed74e48f7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:37.888529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-09211654-3f9b-45c4-9021-931ed74e48f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.890802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68c15a8b34f496392043d7a27658c09'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.908148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:37.910164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 949/1898] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:37.914588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211654-3f9b-45c4-9021-931ed74e48f7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:37.924817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2c27a8fb-cc34-4836-8fda-1d87ab59ef9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68c15a8b34f496392043d7a27658c09'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:37.931735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211654-3f9b-45c4-9021-931ed74e48f7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:37.938107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:37.938536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 950/1899] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:37 2022] DELETE /identity/v3/users/a68c15a8b34f496392043d7a27658c09 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:37.939270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.939645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.940010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.940823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:37.941224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:37.942727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:37.943198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:37.943561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:37.944520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:37.958828 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 950/1900] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:37.963169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:37.965989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.968949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:37.970356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:37.982179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fab559-7545-4c95-bc5c-170bd46d17cd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.046387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 951/1901] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:38.054157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.055317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.056010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.056439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.057171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.057453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.059181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.059419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:38.100719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 951/1902] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:37 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:38.102329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.104055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:38.211772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d28625-85cc-4d58-8f60-0716117aeb22 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.218609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331c5e8-5ad8-401c-9e2e-1f4e506569c1 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.228794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.229470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.229782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.230061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] PATH_INFO: `/v3/projects/e041cdc182c2483ebb7038fd5d83e1d9` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.231350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e041cdc182c2483ebb7038fd5d83e1d9)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.234022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.236742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:38.291187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.291805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.292085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.292392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.293635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e041cdc182c2483ebb7038fd5d83e1d9', 'request_id': 'req-a4370fe8-4216-49bb-b56b-83e4842036ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:38.302191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e041cdc182c2483ebb7038fd5d83e1d9', 'request_id': 'req-a4370fe8-4216-49bb-b56b-83e4842036ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:38.302438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.303793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.309901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e041cdc182c2483ebb7038fd5d83e1d9', 'request_id': 'req-a4370fe8-4216-49bb-b56b-83e4842036ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:38.315799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 952/1903] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:38.316721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.329508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2a96-c63e-4428-a37b-8cbfd8deab7e service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.336725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] The token cache is being invalidate because project e041cdc182c2483ebb7038fd5d83e1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:38.337145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:38.338416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a4370fe8-4216-49bb-b56b-83e4842036ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:38.343529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 952/1904] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:38 2022] DELETE /identity/v3/projects/e041cdc182c2483ebb7038fd5d83e1d9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:38.345614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276db1-a7cf-4c8f-a6c3-71c10b7ac77e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.346026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276db1-a7cf-4c8f-a6c3-71c10b7ac77e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.346465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276db1-a7cf-4c8f-a6c3-71c10b7ac77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.375237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-22276db1-a7cf-4c8f-a6c3-71c10b7ac77e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:38.376912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-22276db1-a7cf-4c8f-a6c3-71c10b7ac77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:38.416558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:38.430887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.431886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.432516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.432803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.435203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.440732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.471148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 953/1905] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:38.481548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b4764-a296-426a-b7f1-b9a17b5c50dd None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.482395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b4764-a296-426a-b7f1-b9a17b5c50dd None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.483202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b4764-a296-426a-b7f1-b9a17b5c50dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.486767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 953/1906] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:38 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:38.490813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.494828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:38.520812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ac2b4764-a296-426a-b7f1-b9a17b5c50dd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:38.523985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ac2b4764-a296-426a-b7f1-b9a17b5c50dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:38.525281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e3ed3-4113-4285-9969-cde7d4866fb4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.539035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.540397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.541059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.542735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.544429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.546589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 954/1907] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:38.547505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.560729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b4764-a296-426a-b7f1-b9a17b5c50dd None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.576767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b4764-a296-426a-b7f1-b9a17b5c50dd None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.581676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.582361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.582622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.582900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.583614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:38.583919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.586397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.589993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 954/1908] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:38.593874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.604013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 955/1909] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:38.605548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc64d-e275-4c94-afd4-ef6b962d2f3e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.608942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.610644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.611279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.611845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.611845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.612594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.614641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.621510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90429-db52-493a-a4f6-ebd60812d0bd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.629568 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 955/1910] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:16:38.631964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.632897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.633087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.633483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.634216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.634368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.637277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.644975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbc66c-3573-49d1-8ade-c7fa316bac04 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.650972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9cb1a-29b4-46cf-b49d-1ccc1e12154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.652219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9cb1a-29b4-46cf-b49d-1ccc1e12154d admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.652368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9cb1a-29b4-46cf-b49d-1ccc1e12154d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.652717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9cb1a-29b4-46cf-b49d-1ccc1e12154d admin admin] PATH_INFO: `/v3/projects/0c84e63d5e9c452f89741dbe1c5eafa7/users/1f5980fb6fc0439aa48a7d694235621f/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.670625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9cb1a-29b4-46cf-b49d-1ccc1e12154d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c84e63d5e9c452f89741dbe1c5eafa7, user_id=1f5980fb6fc0439aa48a7d694235621f, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.673413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9cb1a-29b4-46cf-b49d-1ccc1e12154d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.677854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 956/1911] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:38 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:38.680566 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.692443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 956/1912] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:38 2022] PUT /identity/v3/projects/0c84e63d5e9c452f89741dbe1c5eafa7/users/1f5980fb6fc0439aa48a7d694235621f/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:38.703045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1590-f35e-4ac0-a029-24601a0f9937 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.703333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1590-f35e-4ac0-a029-24601a0f9937 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.703612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1590-f35e-4ac0-a029-24601a0f9937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.733390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d13f1590-f35e-4ac0-a029-24601a0f9937 None None] MFA Rules not processed for user `1f5980fb6fc0439aa48a7d694235621f`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:38.734658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d13f1590-f35e-4ac0-a029-24601a0f9937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:38.751502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:38.765506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5795d-aee9-4666-8c4b-d03b641914c6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.823175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 957/1913] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:38.827555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f1590-f35e-4ac0-a029-24601a0f9937 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.858752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.861543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.861872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.862157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.863301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.865703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.912912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 957/1914] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:38 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:38.914798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:38.918332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:38.931237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f1590-f35e-4ac0-a029-24601a0f9937 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.931408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0a5a-830e-472d-9f23-70c2512224c3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:38.936876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.937256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:38.937527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.937809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.937923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:38.938077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] PATH_INFO: `/v3/projects/05720ed93cb049f99c5e5c37d9faeb75` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.938191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:38.938449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:38.939113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.939273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05720ed93cb049f99c5e5c37d9faeb75)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:38.941180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.941643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:38.980510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 958/1915] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:38 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:38.981637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.027881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:39.047350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05720ed93cb049f99c5e5c37d9faeb75', 'request_id': 'req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.055430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05720ed93cb049f99c5e5c37d9faeb75', 'request_id': 'req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.063220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05720ed93cb049f99c5e5c37d9faeb75', 'request_id': 'req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.078799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] The token cache is being invalidate because project 05720ed93cb049f99c5e5c37d9faeb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:39.079119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.079782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.081920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 958/1916] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:38 2022] DELETE /identity/v3/projects/05720ed93cb049f99c5e5c37d9faeb75 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:39.082693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.083968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:39.096674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3672ac-8739-46eb-86b6-071f67e8afe8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.174815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad44d9-bfdf-43fe-aac0-cf814b6a1163 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.180669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.181203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.181479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.181758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.182533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.184650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.186039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.186892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.187305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.187756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.188723 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.195482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.205146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:39.208341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 959/1917] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:39.209281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.211305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:39.216348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 959/1918] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:39 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:39.218226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.224670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:39.226637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7d7f-1940-40ca-8272-5ca0a0a95ca4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.248641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.250605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.250894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.251175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] PATH_INFO: `/v3/users/3c920668eba24f0fb8bdff9688a8f965` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.254141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c920668eba24f0fb8bdff9688a8f965)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.260793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.265218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ba41e-a4bd-4d69-ad31-597929b37985 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.283894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.284569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.284907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.285650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.286703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.288344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.319219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 960/1919] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:39.323388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.348727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bfd13-4d64-45c8-a42d-f3a4375c5262 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.357926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.358657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c920668eba24f0fb8bdff9688a8f965'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.358998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.359558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.359947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.360203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c920668eba24f0fb8bdff9688a8f965'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.361544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.364929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.379290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c920668eba24f0fb8bdff9688a8f965'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.383330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 961/1920] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:39.384705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.390846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c920668eba24f0fb8bdff9688a8f965'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.405262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15c912-e600-4c84-91ad-65dce9c511dc admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.413234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc789d0-ef94-4ed3-8671-bedea6db36db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.413411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c920668eba24f0fb8bdff9688a8f965'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:39.414471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc789d0-ef94-4ed3-8671-bedea6db36db admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.414983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc789d0-ef94-4ed3-8671-bedea6db36db admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.415737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc789d0-ef94-4ed3-8671-bedea6db36db admin admin] PATH_INFO: `/v3/projects/ae353434c48f41c5ae7bf77c66c9fb90/users/e8c2661ec740495cbb1bd1acb1f60824/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.423649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 960/1921] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:39 2022] DELETE /identity/v3/users/3c920668eba24f0fb8bdff9688a8f965 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:39.424581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.426155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:39.454840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc789d0-ef94-4ed3-8671-bedea6db36db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae353434c48f41c5ae7bf77c66c9fb90, user_id=e8c2661ec740495cbb1bd1acb1f60824, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.459104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc789d0-ef94-4ed3-8671-bedea6db36db admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.478649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:39.488697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 962/1922] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:39 2022] PUT /identity/v3/projects/ae353434c48f41c5ae7bf77c66c9fb90/users/e8c2661ec740495cbb1bd1acb1f60824/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:39.500045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.500400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.500590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.551655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] MFA Rules not processed for user `e8c2661ec740495cbb1bd1acb1f60824`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:39.551884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31926b-9e35-49bc-914f-27139f7a8d70 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.554365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:39.650874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.650874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.652231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.652516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] PATH_INFO: `/v3/projects/0efaf96b3097484694ad3b9a3a0ad403/users/41a0e61f8575416182919ac638922aa7/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.672560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 963/1923] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:39.672560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.675556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:39.680069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efaf96b3097484694ad3b9a3a0ad403, user_id=41a0e61f8575416182919ac638922aa7, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.683381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.704850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4558d9-f423-4ef9-8ffd-5f8b6aecefe8 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.706634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 961/1924] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:39 2022] PUT /identity/v3/projects/0efaf96b3097484694ad3b9a3a0ad403/users/41a0e61f8575416182919ac638922aa7/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:39.710086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.804022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.805109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.805463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.805813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.806612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.806911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b20bd0-b572-4ddf-a23e-942e203a0a36 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.810058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.813562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.814202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.814506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.814940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.816152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.818432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.835772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 962/1925] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:16:39.847998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.862796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d18c82-5355-481c-bd32-d28d6ec07dfe admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.864116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 964/1926] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:39 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:39.868239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:39.915592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:39.939615 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:39.950377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff41f-cdb3-4313-9c72-24ee5b452dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.951706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff41f-cdb3-4313-9c72-24ee5b452dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.952866 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff41f-cdb3-4313-9c72-24ee5b452dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.953302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff41f-cdb3-4313-9c72-24ee5b452dc4 admin admin] PATH_INFO: `/v3/projects/0efaf96b3097484694ad3b9a3a0ad403/users/41a0e61f8575416182919ac638922aa7/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.956075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff41f-cdb3-4313-9c72-24ee5b452dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efaf96b3097484694ad3b9a3a0ad403, user_id=41a0e61f8575416182919ac638922aa7, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.959132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dbd86-8bf0-4529-af5e-37cb8452ba56 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:39.959280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff41f-cdb3-4313-9c72-24ee5b452dc4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.965237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:39.966054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.966483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.966857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:39.967638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:39.970028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:39.975271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 963/1927] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:39 2022] PUT /identity/v3/projects/0efaf96b3097484694ad3b9a3a0ad403/users/41a0e61f8575416182919ac638922aa7/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:39.985983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:39.986575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:39.986853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.010684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 965/1928] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:39 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:40.012456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.030587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040c630-4461-46eb-8851-4bcbc3fb02bf admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:40.036974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] MFA Rules not processed for user `41a0e61f8575416182919ac638922aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:40.039551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:40.156617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:40.157719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.158401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.158900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.159838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:40.161779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:40.176598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 964/1929] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:40.181917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 966/1930] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:40.186585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.188614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:40.192796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.219342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1aa92-590c-4690-a67c-d7d944582626 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:40.235224 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:40.235870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.236150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.236490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.237302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:40.241917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:40.280431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 967/1931] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:40.281411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.288156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:40.324649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562859ac-dd90-416e-9eec-321c7ead88e3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:40.335568 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b694ea-e889-451f-99f0-598bee3498dd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:40.338912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:40.339561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:40.339879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.340190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.340305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.340463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.340653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] PATH_INFO: `/v3/users/3068189449864d479ccd202472ea8da0` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.340758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.342045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3068189449864d479ccd202472ea8da0)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:40.344517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:40.351098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:40.352780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:40.376045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 965/1932] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:40.378659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.404698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48e71-afbc-46d1-ba37-ac4ccd48ea62 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:40.406952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3068189449864d479ccd202472ea8da0'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:40.408178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3068189449864d479ccd202472ea8da0'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:40.417030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd68e-a4b8-4a44-8396-28cdc7207b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:40.419372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3068189449864d479ccd202472ea8da0'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:40.419598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd68e-a4b8-4a44-8396-28cdc7207b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.420302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3068189449864d479ccd202472ea8da0'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:40.420622 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd68e-a4b8-4a44-8396-28cdc7207b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.421052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd68e-a4b8-4a44-8396-28cdc7207b0c admin admin] PATH_INFO: `/v3/projects/4f5ef2f8f24b41c8a3418776a26b07b9/users/697229b5a76d4dc8b05036f1b67cb962/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.438200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-00df77e2-0197-48d0-9198-b1eb17c8f7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3068189449864d479ccd202472ea8da0'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:40.447280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd68e-a4b8-4a44-8396-28cdc7207b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ef2f8f24b41c8a3418776a26b07b9, user_id=697229b5a76d4dc8b05036f1b67cb962, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:40.451421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd68e-a4b8-4a44-8396-28cdc7207b0c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:40.465940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 968/1933] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:40 2022] DELETE /identity/v3/users/3068189449864d479ccd202472ea8da0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:40.471261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.471744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.472741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.482267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 966/1934] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:40 2022] PUT /identity/v3/projects/4f5ef2f8f24b41c8a3418776a26b07b9/users/697229b5a76d4dc8b05036f1b67cb962/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:40.488284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.488577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.488850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.526093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:40.528074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:40.553062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:40.561406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] MFA Rules not processed for user `697229b5a76d4dc8b05036f1b67cb962`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:40.563468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:40.700367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 969/1935] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:40.703697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:40.745005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.746554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:40.780741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 967/1936] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:40.785290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.787955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:40.810864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665718b8-d19e-4efb-a374-ed121c8867e8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:40.819926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:40.820328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:40.820778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:40.821054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:40.822342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:40.826707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:40.890087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 968/1937] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:40 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:40.891910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:40.909655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63a15a-05c0-4888-8173-d1fd626fd5f4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:40.999531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.000663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.000945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.001219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.017288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13aeae-9308-476c-9532-53e979b3837d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.023822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec0abc-a069-4b13-8438-d4a2a26dcfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.024719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0abc-a069-4b13-8438-d4a2a26dcfba admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.025073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0abc-a069-4b13-8438-d4a2a26dcfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.025445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0abc-a069-4b13-8438-d4a2a26dcfba admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.026354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec0abc-a069-4b13-8438-d4a2a26dcfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.030224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec0abc-a069-4b13-8438-d4a2a26dcfba admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.070478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 969/1938] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:40 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:41.072768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce639-1bd4-4089-a9f3-6f3bac616e6c None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.073047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce639-1bd4-4089-a9f3-6f3bac616e6c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.073319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fce639-1bd4-4089-a9f3-6f3bac616e6c None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.075973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 970/1939] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:16:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:16:41.076743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce639-1bd4-4089-a9f3-6f3bac616e6c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.105335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fce639-1bd4-4089-a9f3-6f3bac616e6c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.110978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a45947-1ea4-4944-9b00-d333c397fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.111886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a45947-1ea4-4944-9b00-d333c397fe53 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.112149 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a45947-1ea4-4944-9b00-d333c397fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.112260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.112425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a45947-1ea4-4944-9b00-d333c397fe53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.113111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a45947-1ea4-4944-9b00-d333c397fe53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.114967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a45947-1ea4-4944-9b00-d333c397fe53 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.116217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.127121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 971/1940] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:41.129246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc0ff-a705-44db-ac62-57074de33783 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.129572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc0ff-a705-44db-ac62-57074de33783 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.129847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc0ff-a705-44db-ac62-57074de33783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.130896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 970/1941] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:41.132297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.135194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.156939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6e3dc0ff-a705-44db-ac62-57074de33783 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:41.158299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6e3dc0ff-a705-44db-ac62-57074de33783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.176569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:41.234580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd9876-798a-42c7-abd4-65bc944ebbd9 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.238823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 972/1942] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:41.239645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dc0ff-a705-44db-ac62-57074de33783 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.241759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a0e61f8575416182919ac638922aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0efaf96b3097484694ad3b9a3a0ad403', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.242624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.243035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.243442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.244459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:41.244904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.247022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.252012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dc0ff-a705-44db-ac62-57074de33783 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.257845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.258680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.259029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.259374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] PATH_INFO: `/v3/projects/c4bbf20588cf462dbf2aba8aa7480abc/users/a29b6f108faf43d4b336c991cf09afef/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.264128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 971/1943] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:41.265309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.273218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.284226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bbf20588cf462dbf2aba8aa7480abc, user_id=a29b6f108faf43d4b336c991cf09afef, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.287700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.290075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c72e-cdb3-4f69-8bca-91fa7f1ba157 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.296188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.296854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.297134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.297410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] PATH_INFO: `/v3/projects/4923bef93e8740199816a14cfac5a680` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.298655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4923bef93e8740199816a14cfac5a680)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.300786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.311574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 973/1944] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:41 2022] PUT /identity/v3/projects/c4bbf20588cf462dbf2aba8aa7480abc/users/a29b6f108faf43d4b336c991cf09afef/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:41.312949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.325536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:41.393943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4923bef93e8740199816a14cfac5a680', 'request_id': 'req-46e027f1-3f16-460e-8caa-1a391e9ff7b3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:41.402761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4923bef93e8740199816a14cfac5a680', 'request_id': 'req-46e027f1-3f16-460e-8caa-1a391e9ff7b3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:41.409052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4923bef93e8740199816a14cfac5a680', 'request_id': 'req-46e027f1-3f16-460e-8caa-1a391e9ff7b3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:41.425319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c69d8-1889-4c74-9a83-695accbfb92e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.427154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] The token cache is being invalidate because project 4923bef93e8740199816a14cfac5a680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:41.427462 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:41.428986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:41.431449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 972/1945] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:41 2022] DELETE /identity/v3/projects/4923bef93e8740199816a14cfac5a680 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:41.432382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.439314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.532729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e3eee-b0c0-4146-9b19-1a70ed6b6969 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a0e61f8575416182919ac638922aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0efaf96b3097484694ad3b9a3a0ad403', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.533382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e3eee-b0c0-4146-9b19-1a70ed6b6969 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.533668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e3eee-b0c0-4146-9b19-1a70ed6b6969 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.534038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e3eee-b0c0-4146-9b19-1a70ed6b6969 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.534913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e3eee-b0c0-4146-9b19-1a70ed6b6969 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.538371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e3eee-b0c0-4146-9b19-1a70ed6b6969 tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.541610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e027f1-3f16-460e-8caa-1a391e9ff7b3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.550978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.551885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.552166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.552443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.553157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.554815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.565779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 973/1946] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:41.566611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.568389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.573238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 974/1947] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:41 2022] POST /identity/v3/projects => generated 355 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:41.575471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3045-db64-48b8-9fec-2514af64ca2c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.575833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3045-db64-48b8-9fec-2514af64ca2c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.576183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3045-db64-48b8-9fec-2514af64ca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.602632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8c7e3045-db64-48b8-9fec-2514af64ca2c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:41.603860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8c7e3045-db64-48b8-9fec-2514af64ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.625526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:41.667035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e31882-096b-4b2c-852b-1251cbd03981 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.677729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 975/1948] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:41.678730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e3045-db64-48b8-9fec-2514af64ca2c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.688081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e3045-db64-48b8-9fec-2514af64ca2c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.692879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.693584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.693866 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.694136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] PATH_INFO: `/v3/projects/c4bbf20588cf462dbf2aba8aa7480abc/users/a29b6f108faf43d4b336c991cf09afef/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.696119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bbf20588cf462dbf2aba8aa7480abc, user_id=a29b6f108faf43d4b336c991cf09afef, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.699611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.710141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 976/1949] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:41 2022] PUT /identity/v3/projects/c4bbf20588cf462dbf2aba8aa7480abc/users/a29b6f108faf43d4b336c991cf09afef/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:41.710961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.712479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.743158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.743912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.744692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:41.746585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.747076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.749558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.764800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.766518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.779459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 974/1950] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:41.780524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:41.781883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.788588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47301-3187-4532-8c1e-35f3de16c6fc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.794004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9390fe-c2d0-4088-9feb-2f303873d31b tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a0e61f8575416182919ac638922aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0efaf96b3097484694ad3b9a3a0ad403', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.794777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9390fe-c2d0-4088-9feb-2f303873d31b tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.795122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9390fe-c2d0-4088-9feb-2f303873d31b tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.795486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9390fe-c2d0-4088-9feb-2f303873d31b tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.795589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc6cf-a69a-49ec-a370-c578377c0ba5 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:41.796388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9390fe-c2d0-4088-9feb-2f303873d31b tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:41.796758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9390fe-c2d0-4088-9feb-2f303873d31b tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.798693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9390fe-c2d0-4088-9feb-2f303873d31b tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.811703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 977/1951] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:41.816158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25552cf-7bfc-47fc-9541-e8d41fd6fab9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.816718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25552cf-7bfc-47fc-9541-e8d41fd6fab9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.816718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25552cf-7bfc-47fc-9541-e8d41fd6fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.848047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c25552cf-7bfc-47fc-9541-e8d41fd6fab9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:41.849340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c25552cf-7bfc-47fc-9541-e8d41fd6fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.911311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:41.911973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.912253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.912526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] PATH_INFO: `/v3/projects/4527e74db258421b8dfacebc412db6c9` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.914377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4527e74db258421b8dfacebc412db6c9)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:41.916861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:41.936182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 978/1952] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:41.937288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:41.937579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:41.937870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:41.972798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] MFA Rules not processed for user `a29b6f108faf43d4b336c991cf09afef`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:41.974347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:41.986721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4527e74db258421b8dfacebc412db6c9', 'request_id': 'req-0469826c-a290-479e-8b96-de64530b4f68'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:41.992940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4527e74db258421b8dfacebc412db6c9', 'request_id': 'req-0469826c-a290-479e-8b96-de64530b4f68'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:41.998615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:42.000020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4527e74db258421b8dfacebc412db6c9', 'request_id': 'req-0469826c-a290-479e-8b96-de64530b4f68'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.014759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] The token cache is being invalidate because project 4527e74db258421b8dfacebc412db6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:42.015082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.015687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.017730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 975/1953] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:41 2022] DELETE /identity/v3/projects/4527e74db258421b8dfacebc412db6c9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:42.018296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.019626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.057579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 979/1954] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:42.058981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.060266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.100489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469826c-a290-479e-8b96-de64530b4f68 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.105339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a0e61f8575416182919ac638922aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0efaf96b3097484694ad3b9a3a0ad403', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.105999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.106440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.106724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] PATH_INFO: `/v3/projects/6f4cb85f9050438685b58606a2109d4b` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.107947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f4cb85f9050438685b58606a2109d4b)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.109863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.114654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:42.138181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915285b3-b9ac-4340-a755-cec8ab9d56bb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.140010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.140920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.141103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.141913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.142428 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:42.142810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.144586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.157915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 980/1955] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:42.159160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.160864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.164596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4cb85f9050438685b58606a2109d4b', 'request_id': 'req-7a750aec-dff7-4ae4-9527-8575e5c8da3f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.170855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4cb85f9050438685b58606a2109d4b', 'request_id': 'req-7a750aec-dff7-4ae4-9527-8575e5c8da3f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.173646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1ba53-d9c7-4373-a6f1-82bf671aaada admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.176750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4cb85f9050438685b58606a2109d4b', 'request_id': 'req-7a750aec-dff7-4ae4-9527-8575e5c8da3f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.190624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] The token cache is being invalidate because project 6f4cb85f9050438685b58606a2109d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:42.190914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.191555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.193405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 976/1956] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:42 2022] DELETE /identity/v3/projects/6f4cb85f9050438685b58606a2109d4b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:42.194305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.197848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.235948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.236604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.236887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.237162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] PATH_INFO: `/v3/users/74f58f4556e7496dbdda9dbae9ecbfd1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.238393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f58f4556e7496dbdda9dbae9ecbfd1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.240330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.263806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750aec-dff7-4ae4-9527-8575e5c8da3f tempest-VolumeQuotaClassesTest-656121664 tempest-VolumeQuotaClassesTest-656121664-project-admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.268901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.269630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.269993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.270366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.273444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.294214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f58f4556e7496dbdda9dbae9ecbfd1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.295073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f58f4556e7496dbdda9dbae9ecbfd1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.308235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f58f4556e7496dbdda9dbae9ecbfd1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.315030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:42.316737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f58f4556e7496dbdda9dbae9ecbfd1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.340339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f58f4556e7496dbdda9dbae9ecbfd1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.349907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 981/1957] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:42 2022] DELETE /identity/v3/users/74f58f4556e7496dbdda9dbae9ecbfd1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:42.350755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.365277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.372587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.376320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.392882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 977/1958] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:42.426157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.428555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.461916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1a09-9d2a-456e-90c3-b906df3733d5 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.521075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bba4c-5142-437b-bc96-25a9d5dfe7b9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.528189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.529202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.529738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.530219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.531232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.533811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.539466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:42.585829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 982/1959] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:42 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:42.587938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.590470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.595309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.595976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.596239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.596518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] PATH_INFO: `/v3/users/1f5980fb6fc0439aa48a7d694235621f` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.597744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5980fb6fc0439aa48a7d694235621f)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.599753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.688659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb590a7-bdb7-4c9d-aebb-bc60411c3c70 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.694547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.695482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.695815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.696036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.698745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.708019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5980fb6fc0439aa48a7d694235621f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.709349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5980fb6fc0439aa48a7d694235621f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.720188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5980fb6fc0439aa48a7d694235621f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.721186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5980fb6fc0439aa48a7d694235621f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.740864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5980fb6fc0439aa48a7d694235621f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:42.760272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 978/1960] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:42 2022] DELETE /identity/v3/users/1f5980fb6fc0439aa48a7d694235621f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:42.763820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.765225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.803579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.805141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.828220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 983/1961] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:42.837588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:42.839823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.843044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.860740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364a2fe-40a0-4eef-9d9d-a28133204dff admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.868032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a6e72-56eb-48f1-b193-f38d4af99f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.868675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6e72-56eb-48f1-b193-f38d4af99f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.868955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6e72-56eb-48f1-b193-f38d4af99f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.869225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6e72-56eb-48f1-b193-f38d4af99f90 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.869942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6e72-56eb-48f1-b193-f38d4af99f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.871979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6e72-56eb-48f1-b193-f38d4af99f90 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.897257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 979/1962] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:42 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:42.898785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81ccb9-7017-4fcf-9b0b-0a7ad118e34e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.899244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81ccb9-7017-4fcf-9b0b-0a7ad118e34e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.899880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81ccb9-7017-4fcf-9b0b-0a7ad118e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.923657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6952-e4e0-4acc-ae1c-b465823cfaea service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.926121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2e81ccb9-7017-4fcf-9b0b-0a7ad118e34e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:42.927413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2e81ccb9-7017-4fcf-9b0b-0a7ad118e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:42.928727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.929378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.929659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.929928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] PATH_INFO: `/v3/projects/200ac7c6876141968385cbce4cd50682` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.931131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=200ac7c6876141968385cbce4cd50682)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.933065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.939281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 980/1963] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:42.939281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81ccb9-7017-4fcf-9b0b-0a7ad118e34e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.951623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81ccb9-7017-4fcf-9b0b-0a7ad118e34e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:42.957405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:42.957919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:42.958197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:42.958577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:42.959819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:42.961501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:42.977741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 981/1964] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:42.978781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:42.984245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:43.020851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:43.033754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200ac7c6876141968385cbce4cd50682', 'request_id': 'req-e1365d13-c505-4b92-982e-5356abf9c78c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:43.046812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200ac7c6876141968385cbce4cd50682', 'request_id': 'req-e1365d13-c505-4b92-982e-5356abf9c78c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:43.060562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200ac7c6876141968385cbce4cd50682', 'request_id': 'req-e1365d13-c505-4b92-982e-5356abf9c78c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:43.080270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d13a-c401-4808-af58-ec3c7427d8a3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.082890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] The token cache is being invalidate because project 200ac7c6876141968385cbce4cd50682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:43.084318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:43.085299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:43.089480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 984/1965] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:42 2022] DELETE /identity/v3/projects/200ac7c6876141968385cbce4cd50682 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:43.092735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.095440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:43.168131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.171170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.171764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.172009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.178687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:43.252907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1365d13-c505-4b92-982e-5356abf9c78c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.258865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7ebb3-004c-4624-ba5f-706e2d26bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.259788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ebb3-004c-4624-ba5f-706e2d26bb0f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.260243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ebb3-004c-4624-ba5f-706e2d26bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.260697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ebb3-004c-4624-ba5f-706e2d26bb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.261654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7ebb3-004c-4624-ba5f-706e2d26bb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.263476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7ebb3-004c-4624-ba5f-706e2d26bb0f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:43.274287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 985/1966] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:43.275848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390da97-4034-47c5-9e70-bd7c3c566214 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.276355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390da97-4034-47c5-9e70-bd7c3c566214 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.276872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390da97-4034-47c5-9e70-bd7c3c566214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.285338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.288713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:43.304121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 982/1967] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:43.306464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.307746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a390da97-4034-47c5-9e70-bd7c3c566214 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:43.309841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a390da97-4034-47c5-9e70-bd7c3c566214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:43.320555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 986/1968] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:43.321782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811495b1-9e55-4b40-b23d-21ab0c405e6d service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.327943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a2941-f184-47c2-95ee-2fa5de1062a1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.328215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee01b5-e7c1-47b7-b7be-15f2bd273313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.328332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a2941-f184-47c2-95ee-2fa5de1062a1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.328512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a2941-f184-47c2-95ee-2fa5de1062a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.328887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee01b5-e7c1-47b7-b7be-15f2bd273313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.329173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee01b5-e7c1-47b7-b7be-15f2bd273313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.329446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee01b5-e7c1-47b7-b7be-15f2bd273313 admin admin] PATH_INFO: `/v3/projects/94c5f2e9ebd3436ea0f83f2762058af1/users/367bc991a2ff4fe6b213929f5d3e1411/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.362666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee01b5-e7c1-47b7-b7be-15f2bd273313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c5f2e9ebd3436ea0f83f2762058af1, user_id=367bc991a2ff4fe6b213929f5d3e1411, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.367232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee01b5-e7c1-47b7-b7be-15f2bd273313 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:43.383461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5a7a2941-f184-47c2-95ee-2fa5de1062a1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:43.385043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5a7a2941-f184-47c2-95ee-2fa5de1062a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:43.399007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 983/1969] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:43 2022] PUT /identity/v3/projects/94c5f2e9ebd3436ea0f83f2762058af1/users/367bc991a2ff4fe6b213929f5d3e1411/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:43.407875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.410517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.411531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.437580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:43.484156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] MFA Rules not processed for user `367bc991a2ff4fe6b213929f5d3e1411`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:43.486017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:43.553080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 987/1970] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:43.557352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a2941-f184-47c2-95ee-2fa5de1062a1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.569098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a2941-f184-47c2-95ee-2fa5de1062a1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.588456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.591936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.592385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.592809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.595789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:43.596285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.600692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:43.631620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 988/1971] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:16:43.632918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 984/1972] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:43.637975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.647700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.649720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:43.655633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458114-bdb6-4f1c-b40d-8445fbb1c10f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.661557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.662362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.662697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.662982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.663817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.666134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:43.705347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 989/1973] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:43 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:43.706594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.775541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:43.802706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee027a-a6c9-4022-9f78-d4f7bf96eb65 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.834118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09423-aad2-4aac-8e6d-d8adab9a5315 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.840332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.840964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.841244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.841522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.842769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.846884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:43.883223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 990/1974] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:43 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:43.889512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.907271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78519733-1d02-43a2-af42-b545d167f22b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.916985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.918782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.919781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.920859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.921534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.926277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:43.939376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d715be-90ef-4dbc-965e-8e18567723d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.940817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d715be-90ef-4dbc-965e-8e18567723d5 service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.941201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d715be-90ef-4dbc-965e-8e18567723d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.941578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d715be-90ef-4dbc-965e-8e18567723d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.966338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 991/1975] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:43.967564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:43.982180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b1399-a97c-4069-98b9-14e18321447b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:43.989971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:43.991943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:43.992506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:43.992789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:43.993674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:43.996319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.008491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:44.021602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 992/1976] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:44.023209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:44.039800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d715be-90ef-4dbc-965e-8e18567723d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.041327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d715be-90ef-4dbc-965e-8e18567723d5 service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.064001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80eaa1-010f-4837-bd62-94aeb7995922 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:44.067621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 985/1977] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:44.082062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:44.082785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.083061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.083330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] PATH_INFO: `/v3/projects/f91c0c93c4984e7298a973b3f0ffea27/users/3207ddf5de824b9991aacb5e8bd24b58/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.106367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91c0c93c4984e7298a973b3f0ffea27, user_id=3207ddf5de824b9991aacb5e8bd24b58, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.109274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.138526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 993/1978] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:44 2022] PUT /identity/v3/projects/f91c0c93c4984e7298a973b3f0ffea27/users/3207ddf5de824b9991aacb5e8bd24b58/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:44.144787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.145079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.145354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.218414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] MFA Rules not processed for user `3207ddf5de824b9991aacb5e8bd24b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:44.219878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:44.322575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 986/1979] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:44.327293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:44.348399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:44.350147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:44.457634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafe9db-524a-4303-bcc9-3b62cd928edf admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:44.464349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:44.465490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.466269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.466269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.466810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.468717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.476450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ab19b-bb0d-40a4-a07b-62114fc582d7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:44.482146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:44.483025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.483311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.483591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] PATH_INFO: `/v3/projects/0c84e63d5e9c452f89741dbe1c5eafa7` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.484793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c84e63d5e9c452f89741dbe1c5eafa7)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.486873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.513743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 994/1980] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:44 2022] POST /identity/v3/projects => generated 389 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:44.518325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:44.555222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c84e63d5e9c452f89741dbe1c5eafa7', 'request_id': 'req-49e25387-562f-405f-8eaa-72a2f27394f6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.566677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c84e63d5e9c452f89741dbe1c5eafa7', 'request_id': 'req-49e25387-562f-405f-8eaa-72a2f27394f6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.590673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c84e63d5e9c452f89741dbe1c5eafa7', 'request_id': 'req-49e25387-562f-405f-8eaa-72a2f27394f6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.612949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:44.616754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] The token cache is being invalidate because project 0c84e63d5e9c452f89741dbe1c5eafa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:44.617196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.621118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.630394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 987/1981] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:44 2022] DELETE /identity/v3/projects/0c84e63d5e9c452f89741dbe1c5eafa7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:44.631539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca316e3a-343f-45fd-8e53-97ca7630add5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:44.633279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:44.637154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:44.653519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:44.764973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:44.766854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.767137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.767413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.770475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.774504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.784979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25387-562f-405f-8eaa-72a2f27394f6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:44.797761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:44.798778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.799206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.799624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] PATH_INFO: `/v3/users/41a0e61f8575416182919ac638922aa7` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.802329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a0e61f8575416182919ac638922aa7)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.810606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.818343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 995/1982] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:44 2022] POST /identity/v3/users => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:44.820647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:44.827647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:44.853918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82645fa9-bfe4-478f-8adc-0689d1440754 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:44.878187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:44.879554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.879838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.880115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.881338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.887677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.915796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 996/1983] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:44.918411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a0e61f8575416182919ac638922aa7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.918604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:44.919108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a0e61f8575416182919ac638922aa7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.931781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a0e61f8575416182919ac638922aa7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.932040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a00cb-fb3a-4a84-9af3-1c3488940427 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:44.932690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a0e61f8575416182919ac638922aa7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.938549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:44.939240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:44.939520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:44.939796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] PATH_INFO: `/v3/projects/b8e63eaa8ed342f2894c07d878674419/users/6691844680774be38522b57fd0378288/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:44.949176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a0e61f8575416182919ac638922aa7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:44.962529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e63eaa8ed342f2894c07d878674419, user_id=6691844680774be38522b57fd0378288, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:44.968795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 988/1984] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:44 2022] DELETE /identity/v3/users/41a0e61f8575416182919ac638922aa7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:44.980124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:44.999282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 997/1985] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:44 2022] PUT /identity/v3/projects/b8e63eaa8ed342f2894c07d878674419/users/6691844680774be38522b57fd0378288/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:45.003365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:45.004930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:45.095253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725feee-0147-4e4b-aa04-0382d79afd95 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:45.143716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:45.193827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2afa-0ded-4c2b-a510-17889b997ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:45.194364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2afa-0ded-4c2b-a510-17889b997ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.194691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2afa-0ded-4c2b-a510-17889b997ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.194973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2afa-0ded-4c2b-a510-17889b997ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.195677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2afa-0ded-4c2b-a510-17889b997ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:45.197655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2afa-0ded-4c2b-a510-17889b997ac0 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:45.208644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 989/1986] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:45.215619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:45.227778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03045ebd-3900-404f-9bfe-31742d8c0c22 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:45.234475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:45.246860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.246860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.246860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] PATH_INFO: `/v3/projects/b8e63eaa8ed342f2894c07d878674419/users/6691844680774be38522b57fd0378288/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.246860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e63eaa8ed342f2894c07d878674419, user_id=6691844680774be38522b57fd0378288, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:45.246860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:45.278022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 998/1987] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:45 2022] PUT /identity/v3/projects/b8e63eaa8ed342f2894c07d878674419/users/6691844680774be38522b57fd0378288/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:45.293823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.294206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.294589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.355463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] MFA Rules not processed for user `6691844680774be38522b57fd0378288`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:45.356883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:45.445629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 990/1988] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:45.457533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:45.459596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:45.525824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e019e0-f0db-45ad-9370-33c1f0182359 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:45.530217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:45.530883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.531158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.531426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.540488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:45.541902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:45.551410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 999/1989] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:45.669445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:45.672907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:45.739066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:45.781033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dd348-0dae-471e-b729-9cc2164dd0a5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:45.786060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:45.786744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.787031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.787307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] PATH_INFO: `/v3/projects/0efaf96b3097484694ad3b9a3a0ad403` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.788478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efaf96b3097484694ad3b9a3a0ad403)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:45.790474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:45.790614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:45.811400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aad08-afee-47b4-afd3-1143efb44442 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:45.816014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:45.816654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.816929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.817204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] PATH_INFO: `/v3/users/3207ddf5de824b9991aacb5e8bd24b58` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.818423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3207ddf5de824b9991aacb5e8bd24b58)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:45.820388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:45.841405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efaf96b3097484694ad3b9a3a0ad403', 'request_id': 'req-06a3858f-9221-45c4-ac50-53a9be600aa5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.848541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:45.854866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efaf96b3097484694ad3b9a3a0ad403', 'request_id': 'req-06a3858f-9221-45c4-ac50-53a9be600aa5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.862333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efaf96b3097484694ad3b9a3a0ad403', 'request_id': 'req-06a3858f-9221-45c4-ac50-53a9be600aa5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.882644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] The token cache is being invalidate because project 0efaf96b3097484694ad3b9a3a0ad403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:45.882941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.883695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-06a3858f-9221-45c4-ac50-53a9be600aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.884283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3207ddf5de824b9991aacb5e8bd24b58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.885069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3207ddf5de824b9991aacb5e8bd24b58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.885588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 991/1990] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:45 2022] DELETE /identity/v3/projects/0efaf96b3097484694ad3b9a3a0ad403 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:45.891767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257bb3c-cade-46a5-8ece-ba957199a728 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.892421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257bb3c-cade-46a5-8ece-ba957199a728 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.892996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257bb3c-cade-46a5-8ece-ba957199a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.898225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3207ddf5de824b9991aacb5e8bd24b58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.909260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3207ddf5de824b9991aacb5e8bd24b58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.926274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-b257bb3c-cade-46a5-8ece-ba957199a728 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:45.926274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b257bb3c-cade-46a5-8ece-ba957199a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:45.926545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6dbd5ef9-3c79-49d9-ac3b-f25f1b7ccb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3207ddf5de824b9991aacb5e8bd24b58'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:45.932417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1000/1991] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:45 2022] DELETE /identity/v3/users/3207ddf5de824b9991aacb5e8bd24b58 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:45.937541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f096-7566-4ceb-b1b0-d220064b3176 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.937899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f096-7566-4ceb-b1b0-d220064b3176 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:45.938255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f096-7566-4ceb-b1b0-d220064b3176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:45.958947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-58d7f096-7566-4ceb-b1b0-d220064b3176 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:45.960236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-58d7f096-7566-4ceb-b1b0-d220064b3176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:45.990077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 992/1992] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:45.999417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:45.999808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.000149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.021303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:46.022653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.023672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1001/1993] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:46.031661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 993/1994] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:46.035720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f096-7566-4ceb-b1b0-d220064b3176 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.036464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.037729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.046824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f096-7566-4ceb-b1b0-d220064b3176 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.052015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.052643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.052921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.053193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.053895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:46.054219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.055889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.069673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1002/1995] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:16:46.074362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.083991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8fec-4c46-47ce-a165-a0b53afc0aef admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.089255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.089884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.090165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.090482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.091133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.093012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.109770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb76566-f04b-421a-b7ab-5b2df974a2c3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.115169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.116559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.116790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.117068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.127904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.130615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.145524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 994/1996] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:46.152170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1003/1997] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:46 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:46.156395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.167611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3656b3-318e-4329-8b7b-d10a0b3cb424 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.243796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.246576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.246576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.246576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.246576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.248272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.276623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 995/1998] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:46 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:46.280681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.300339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33d11e-84f5-4654-949c-39c9941587fe admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.306332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.307279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.308209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.308582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.309585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.313693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.329443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1004/1999] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:46.331138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.351128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba4642-e371-49f2-a368-83e8f6e225e9 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.361822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.362531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.362803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.363070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.363802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.365437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.367786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:46.371515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.373889 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.386444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 996/2000] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:46.388633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.400042 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e630900-3ef4-4edf-8381-4e47f546d9cd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.404724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeed11-0b73-4760-88d5-c59a731957c2 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.406168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.406963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.407437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.407704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] PATH_INFO: `/v3/users/e8c2661ec740495cbb1bd1acb1f60824` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.410669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c2661ec740495cbb1bd1acb1f60824)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.411330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.426105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cd78a-c280-465f-8a24-4659c84867c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.426492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd78a-c280-465f-8a24-4659c84867c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.429179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd78a-c280-465f-8a24-4659c84867c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.429574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd78a-c280-465f-8a24-4659c84867c3 admin admin] PATH_INFO: `/v3/projects/f51d1706dbca46c5bfc53d2eea562d71/users/6ecb989cf0cf43519405df620e8980a6/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.437860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:46.463327 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cd78a-c280-465f-8a24-4659c84867c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51d1706dbca46c5bfc53d2eea562d71, user_id=6ecb989cf0cf43519405df620e8980a6, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.469397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cd78a-c280-465f-8a24-4659c84867c3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.507859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 997/2001] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:46 2022] PUT /identity/v3/projects/f51d1706dbca46c5bfc53d2eea562d71/users/6ecb989cf0cf43519405df620e8980a6/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:46.509313 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c2661ec740495cbb1bd1acb1f60824'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:46.510013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c2661ec740495cbb1bd1acb1f60824'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:46.511041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.511504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.511944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.527526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c2661ec740495cbb1bd1acb1f60824'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:46.543931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c2661ec740495cbb1bd1acb1f60824'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:46.554781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] MFA Rules not processed for user `6ecb989cf0cf43519405df620e8980a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:46.556417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.561136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-83b289aa-a278-40b6-b6a0-b9b71c7402b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c2661ec740495cbb1bd1acb1f60824'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:46.568444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1005/2002] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:46 2022] DELETE /identity/v3/users/e8c2661ec740495cbb1bd1acb1f60824 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:46.573538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.574073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.574606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.601909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:46.603436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.662518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 998/2003] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:46.667004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.670548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.750808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1006/2004] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:46.752299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.762111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.818116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb49ce-42cb-4d1f-830e-38697a97765b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.824022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.824670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.824952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.825280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.826699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.828987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.847894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744a653-ddad-4eb0-8be1-070e985d0ac2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.854267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:46.855090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:46.855475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:46.855862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:46.871680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:46.872752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 999/2005] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:46 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:46.873304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:46.874280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.878121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:46.889609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1007/2006] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:46.889609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:46.899780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a048-6b25-4eb6-a642-3c43d975350f service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:46.964902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:46.971203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:47.000704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63884e2e-6f71-4637-95bd-f8e73c08ff65 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.006785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.007391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.007649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.008034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.008152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.008401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.008561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.008665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] PATH_INFO: `/v3/projects/f91c0c93c4984e7298a973b3f0ffea27` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.009567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.009955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91c0c93c4984e7298a973b3f0ffea27)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.013253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.013906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.082190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1008/2007] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:46 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:47.085902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.098650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91c0c93c4984e7298a973b3f0ffea27', 'request_id': 'req-ec2ed8e2-de99-4b7b-8912-282543c9563f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.101915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee34b9-e745-468c-a0e9-e0c4fc756812 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.111104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91c0c93c4984e7298a973b3f0ffea27', 'request_id': 'req-ec2ed8e2-de99-4b7b-8912-282543c9563f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.120617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91c0c93c4984e7298a973b3f0ffea27', 'request_id': 'req-ec2ed8e2-de99-4b7b-8912-282543c9563f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.139761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] The token cache is being invalidate because project f91c0c93c4984e7298a973b3f0ffea27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:47.140161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.141710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.143527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1000/2008] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:46 2022] DELETE /identity/v3/projects/f91c0c93c4984e7298a973b3f0ffea27 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:47.147622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.149125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.183919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.184452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.184732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.185002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.185824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.187340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.201743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1009/2009] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:16:47.205860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.207917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.222940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0efac-1296-4954-ab72-a9c64b5c10bb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.227834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.228513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.228791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.229051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] PATH_INFO: `/v3/projects/c27e643eb6614763b4c6a16fc355dffb/users/2510f78621654be184ae4644b4f14243/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.232010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ed8e2-de99-4b7b-8912-282543c9563f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.237956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.238744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.239025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.239359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] PATH_INFO: `/v3/users/6691844680774be38522b57fd0378288` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.242562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6691844680774be38522b57fd0378288)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.242748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.245512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27e643eb6614763b4c6a16fc355dffb, user_id=2510f78621654be184ae4644b4f14243, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.248220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.272450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1010/2010] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:47 2022] PUT /identity/v3/projects/c27e643eb6614763b4c6a16fc355dffb/users/2510f78621654be184ae4644b4f14243/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:47.276581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.313543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6691844680774be38522b57fd0378288'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.317534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6691844680774be38522b57fd0378288'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.331429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6691844680774be38522b57fd0378288'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.332347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6691844680774be38522b57fd0378288'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.352615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6691844680774be38522b57fd0378288'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.360060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:47.364910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2168-fd6c-49ff-a239-e4852491a858 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.371482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1001/2011] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:47 2022] DELETE /identity/v3/users/6691844680774be38522b57fd0378288 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:47.375636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.378189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.383544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.384302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.384679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.385089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.386473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.388082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.401467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1011/2012] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:47.406010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.408043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.425854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845fd5d-9626-45e7-a824-34bbaab6edbe admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.481038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3dc64-97b0-4712-8982-49d372752e9a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.483369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:47.493933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.495518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.496012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.496721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] PATH_INFO: `/v3/projects/ae353434c48f41c5ae7bf77c66c9fb90` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.498181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae353434c48f41c5ae7bf77c66c9fb90)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.500350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.538197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafa63c-238b-4e02-80d3-015de19a175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.539068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafa63c-238b-4e02-80d3-015de19a175b admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.540532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafa63c-238b-4e02-80d3-015de19a175b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.540846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafa63c-238b-4e02-80d3-015de19a175b admin admin] PATH_INFO: `/v3/projects/c27e643eb6614763b4c6a16fc355dffb/users/2510f78621654be184ae4644b4f14243/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.547413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafa63c-238b-4e02-80d3-015de19a175b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27e643eb6614763b4c6a16fc355dffb, user_id=2510f78621654be184ae4644b4f14243, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.550119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafa63c-238b-4e02-80d3-015de19a175b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.567451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1012/2013] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:47 2022] PUT /identity/v3/projects/c27e643eb6614763b4c6a16fc355dffb/users/2510f78621654be184ae4644b4f14243/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:47.579328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.579733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.580275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.597784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae353434c48f41c5ae7bf77c66c9fb90', 'request_id': 'req-42985c73-306c-44c0-b324-c624c79404f6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.605170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae353434c48f41c5ae7bf77c66c9fb90', 'request_id': 'req-42985c73-306c-44c0-b324-c624c79404f6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.611819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae353434c48f41c5ae7bf77c66c9fb90', 'request_id': 'req-42985c73-306c-44c0-b324-c624c79404f6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.636217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] The token cache is being invalidate because project ae353434c48f41c5ae7bf77c66c9fb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:47.637746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.640563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] MFA Rules not processed for user `2510f78621654be184ae4644b4f14243`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:47.640997 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.641829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.647425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1002/2014] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:47 2022] DELETE /identity/v3/projects/ae353434c48f41c5ae7bf77c66c9fb90 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:47.649107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.653113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.741864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1013/2015] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:47.751803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42985c73-306c-44c0-b324-c624c79404f6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.755698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.759314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.800133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:47.835874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.836536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.836826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.837105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] PATH_INFO: `/v3/users/697229b5a76d4dc8b05036f1b67cb962` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.838329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697229b5a76d4dc8b05036f1b67cb962)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.840295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.846385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837963fa-2af9-46f6-99f0-6bbbe451b2d0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.853793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.855136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.855483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.855867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.867376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.868942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.881501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1014/2016] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:47.883367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:47.884657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:47.892421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697229b5a76d4dc8b05036f1b67cb962'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.893274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697229b5a76d4dc8b05036f1b67cb962'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.898192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc08c-60c1-46ec-a5f3-2d8739099ec5 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:47.902653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697229b5a76d4dc8b05036f1b67cb962'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.903520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697229b5a76d4dc8b05036f1b67cb962'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.907590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:47.908484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:47.908973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:47.909258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] PATH_INFO: `/v3/projects/b8e63eaa8ed342f2894c07d878674419` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:47.910885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e63eaa8ed342f2894c07d878674419)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:47.912938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:47.918356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb336fb1-2c0a-4712-bc25-504347d09505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697229b5a76d4dc8b05036f1b67cb962'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.939010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1003/2017] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:47 2022] DELETE /identity/v3/users/697229b5a76d4dc8b05036f1b67cb962 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:47.969724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:47.971392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e63eaa8ed342f2894c07d878674419', 'request_id': 'req-87c0e4dd-6603-44cb-94f4-e98ff328aabe'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.988555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e63eaa8ed342f2894c07d878674419', 'request_id': 'req-87c0e4dd-6603-44cb-94f4-e98ff328aabe'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:47.997444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e63eaa8ed342f2894c07d878674419', 'request_id': 'req-87c0e4dd-6603-44cb-94f4-e98ff328aabe'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.012676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] The token cache is being invalidate because project b8e63eaa8ed342f2894c07d878674419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:48.012892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.013871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-87c0e4dd-6603-44cb-94f4-e98ff328aabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.015877 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1015/2018] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:47 2022] DELETE /identity/v3/projects/b8e63eaa8ed342f2894c07d878674419 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:48.022572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a27b62-7920-4ca4-aeea-c2fe4734a443 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.022856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a27b62-7920-4ca4-aeea-c2fe4734a443 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.023128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a27b62-7920-4ca4-aeea-c2fe4734a443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.050124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e1a27b62-7920-4ca4-aeea-c2fe4734a443 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:48.051595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e1a27b62-7920-4ca4-aeea-c2fe4734a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:48.185040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1004/2019] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:48.194123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c33f2-1312-44e6-8e7e-8beb875b7d04 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.194605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c33f2-1312-44e6-8e7e-8beb875b7d04 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.194984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c33f2-1312-44e6-8e7e-8beb875b7d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.218300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-db4c33f2-1312-44e6-8e7e-8beb875b7d04 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:48.219614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-db4c33f2-1312-44e6-8e7e-8beb875b7d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:48.228291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1016/2020] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:48.233965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a27b62-7920-4ca4-aeea-c2fe4734a443 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.244229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a27b62-7920-4ca4-aeea-c2fe4734a443 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.249035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.249789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.250178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.250616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.251610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:48.251845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.253578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.267989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1005/2021] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:48.272453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c33f2-1312-44e6-8e7e-8beb875b7d04 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.284131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c33f2-1312-44e6-8e7e-8beb875b7d04 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.295329 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.296297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.296659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.297006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.297794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.299947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.342254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1017/2022] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:48 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:48.343206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.359386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5c993-e687-4ac9-ba5e-b12f08320327 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.441212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:48.510259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.510259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.510259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.510259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.511349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.511349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.535189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1006/2023] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:48 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:48.539443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.548848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.551157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:48.554366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d1da-1050-4723-a7c0-1cd8aa312dba admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.567027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcca00-156c-4433-a239-8598c61f9fe1 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.570502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.571451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.571815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.572629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.574013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.575517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.576207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.576686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.577290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.577793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] PATH_INFO: `/v3/projects/4f5ef2f8f24b41c8a3418776a26b07b9` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.579843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5ef2f8f24b41c8a3418776a26b07b9)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.582247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.616036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1018/2024] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:48.617100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.633052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca5e9-ea69-447c-966c-d9b1ac52c75a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.638362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.639620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.639908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.640187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.641148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.643415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.660316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5ef2f8f24b41c8a3418776a26b07b9', 'request_id': 'req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.664225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1019/2025] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:48.665493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.668292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5ef2f8f24b41c8a3418776a26b07b9', 'request_id': 'req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.679190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5ef2f8f24b41c8a3418776a26b07b9', 'request_id': 'req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.682992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1a53-0454-4515-9b52-0f169f02673c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.700831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] The token cache is being invalidate because project 4f5ef2f8f24b41c8a3418776a26b07b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:48.700831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.701686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.703828 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1007/2026] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:48 2022] DELETE /identity/v3/projects/4f5ef2f8f24b41c8a3418776a26b07b9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:48.707931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.710016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:48.776161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.776808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.778547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.778547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] PATH_INFO: `/v3/projects/2d255269dd834883b8b06e594fd4b5da/users/26981a5697754fb38d81ec172df86ed8/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.794182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d255269dd834883b8b06e594fd4b5da, user_id=26981a5697754fb38d81ec172df86ed8, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.797066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.820878 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1020/2027] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:48 2022] PUT /identity/v3/projects/2d255269dd834883b8b06e594fd4b5da/users/26981a5697754fb38d81ec172df86ed8/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:48.825046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:48.827424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:48.838892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea0cb-b830-4b2f-91a1-aec04cc3ec48 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.925544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.926452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.926817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.927201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] PATH_INFO: `/v3/users/a29b6f108faf43d4b336c991cf09afef` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.928773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29b6f108faf43d4b336c991cf09afef)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.930904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.933173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:48.950413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dca307-378a-4529-8405-1615493215e9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:48.957364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:48.958025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:48.958337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:48.958612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] PATH_INFO: `/v3/users/6ecb989cf0cf43519405df620e8980a6` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:48.961018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ecb989cf0cf43519405df620e8980a6)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:48.966401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:48.978719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:48.996298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29b6f108faf43d4b336c991cf09afef'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:48.998724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29b6f108faf43d4b336c991cf09afef'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.009100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29b6f108faf43d4b336c991cf09afef'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.013780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29b6f108faf43d4b336c991cf09afef'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.031718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16ffd52-ba62-467f-87c0-e772487850ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29b6f108faf43d4b336c991cf09afef'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.043602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ecb989cf0cf43519405df620e8980a6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.044904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ecb989cf0cf43519405df620e8980a6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.058931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ecb989cf0cf43519405df620e8980a6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.062468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1008/2028] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:48 2022] DELETE /identity/v3/users/a29b6f108faf43d4b336c991cf09afef => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:49.062468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.062468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.062468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.082315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ecb989cf0cf43519405df620e8980a6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.093663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] MFA Rules not processed for user `26981a5697754fb38d81ec172df86ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:49.095196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.101297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6a72ef75-61ba-48c4-b708-151a49465655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ecb989cf0cf43519405df620e8980a6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.109691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1021/2029] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:48 2022] DELETE /identity/v3/users/6ecb989cf0cf43519405df620e8980a6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:49.115312 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.115546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.115995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.143212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:49.144578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.214407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1009/2030] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:49.226039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:49.227975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.234492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1022/2031] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:49.245760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:49.248203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.304970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504d14c-784e-4fc3-9ce9-5de83f00fc64 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:49.321489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13063db-2b2a-483e-a4ad-fd797da2f9fa None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:49.326787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:49.327507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.327857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.328402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.328577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:49.340999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:49.343948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:49.360475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1023/2032] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:49.366583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:49.367276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.367565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.368021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.452236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:49.453885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:49.465994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1010/2033] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:49.475085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:49.476577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.488003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:49.490723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.497331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650bd79-2454-4ae4-b5d6-f10b1cd04e49 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:49.504028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:49.508111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428804f1-c0da-4b35-894c-0042dc48542c service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:49.526986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:49.527925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.528345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.528625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] PATH_INFO: `/v3/users/26981a5697754fb38d81ec172df86ed8` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.530409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26981a5697754fb38d81ec172df86ed8)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:49.531471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.531471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.531471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] PATH_INFO: `/v3/projects/c4bbf20588cf462dbf2aba8aa7480abc` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.532085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:49.537655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bbf20588cf462dbf2aba8aa7480abc)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:49.539911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:49.607134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:49.649242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bbf20588cf462dbf2aba8aa7480abc', 'request_id': 'req-e6024531-331f-483f-bfe4-c8b0d764a89d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.654965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26981a5697754fb38d81ec172df86ed8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.656486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26981a5697754fb38d81ec172df86ed8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.663018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bbf20588cf462dbf2aba8aa7480abc', 'request_id': 'req-e6024531-331f-483f-bfe4-c8b0d764a89d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.669633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26981a5697754fb38d81ec172df86ed8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.669633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26981a5697754fb38d81ec172df86ed8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.682586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-4a711f06-3f67-49a4-b02c-ae8378185382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26981a5697754fb38d81ec172df86ed8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.684775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bbf20588cf462dbf2aba8aa7480abc', 'request_id': 'req-e6024531-331f-483f-bfe4-c8b0d764a89d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.704935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1011/2034] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:49 2022] DELETE /identity/v3/users/26981a5697754fb38d81ec172df86ed8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:49.707903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] The token cache is being invalidate because project c4bbf20588cf462dbf2aba8aa7480abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:49.707903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.709865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.709865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.710059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.710456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e6024531-331f-483f-bfe4-c8b0d764a89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.712679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1024/2035] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:49 2022] DELETE /identity/v3/projects/c4bbf20588cf462dbf2aba8aa7480abc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:49.719006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.721060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.721727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.753567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:49.754843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.763288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:49.764542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.821892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:49.856250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1012/2036] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:49.857813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:49.858201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1025/2037] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:49.862911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.866396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:49.867834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.878053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86877912-803d-4e64-96fd-5daddfa88e4f None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:49.883018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:49.883691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.883971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.884243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] PATH_INFO: `/v3/projects/f51d1706dbca46c5bfc53d2eea562d71` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.885475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51d1706dbca46c5bfc53d2eea562d71)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:49.887946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:49.937186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a0302-c96c-4d50-a94c-567718ba1d11 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:49.943661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51d1706dbca46c5bfc53d2eea562d71', 'request_id': 'req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.952209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51d1706dbca46c5bfc53d2eea562d71', 'request_id': 'req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.958186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51d1706dbca46c5bfc53d2eea562d71', 'request_id': 'req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.972331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] The token cache is being invalidate because project f51d1706dbca46c5bfc53d2eea562d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:49.972622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.973338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2919ca3a-95b2-4ce2-9e5c-cbd55bc536fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:49.975580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1013/2038] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:49 2022] DELETE /identity/v3/projects/f51d1706dbca46c5bfc53d2eea562d71 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:49.977100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.977387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.977703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.995718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:49.996348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:49.996785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:49.997114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:49.998265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:49.998932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:49.999543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:50.029626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:50.078655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1014/2039] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:50.079295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.080888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:50.086214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.087919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.096968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790c81-cce4-4bcf-b1e2-cbab31c3aa27 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.102047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.102200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1026/2040] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:50.103072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.103212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.103613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.104184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] PATH_INFO: `/v3/users/2510f78621654be184ae4644b4f14243` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.105615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2510f78621654be184ae4644b4f14243)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.108553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.116883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eceda-abe1-4930-b774-c4eaabf6d5a4 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.122704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.123435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.123793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.124142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.124928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:50.125601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.127679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.157647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1027/2041] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:50.168330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.185070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8773d8-a884-4ede-802b-83351361fdc2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.192635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.193416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.193796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.194166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.194921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.197369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2510f78621654be184ae4644b4f14243'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:50.197468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.197755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2510f78621654be184ae4644b4f14243'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:50.206295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2510f78621654be184ae4644b4f14243'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:50.206951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2510f78621654be184ae4644b4f14243'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:50.225020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:50.228682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2510f78621654be184ae4644b4f14243'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:50.254120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1015/2043] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:50 2022] DELETE /identity/v3/users/2510f78621654be184ae4644b4f14243 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:50.254531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.257352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1028/2043] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:50 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:50.265128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:50.420604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e1f3-56b4-43f8-8db3-c8b1692dc7bc admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.427693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.428702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.429359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.432302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.433907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.436234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.502275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1016/2044] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:50 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:50.503531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.585938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afd2a-c3a1-40da-bfd6-e25e8cf67cfb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.591043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.591663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.592015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.592234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.592970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.594540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.612549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1029/2045] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:50.616551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.633685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9bc7d-b6c7-45c4-9983-67a6b29eee47 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.641948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.642631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.642998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.643371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.644742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.646602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.659443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1017/2046] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:50.663435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.680861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60520-e8a9-4dc3-9519-403b93637492 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.689742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b583d-e3e5-451b-a68e-98318e3a0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.690930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b583d-e3e5-451b-a68e-98318e3a0ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.691901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b583d-e3e5-451b-a68e-98318e3a0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.692416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b583d-e3e5-451b-a68e-98318e3a0ea2 admin admin] PATH_INFO: `/v3/projects/b13184f6f51b47cca73b68621f6b535b/users/b7770428a090476ca00cf90b52954beb/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.716399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b583d-e3e5-451b-a68e-98318e3a0ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13184f6f51b47cca73b68621f6b535b, user_id=b7770428a090476ca00cf90b52954beb, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.720557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b583d-e3e5-451b-a68e-98318e3a0ea2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.750702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1030/2047] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:50 2022] PUT /identity/v3/projects/b13184f6f51b47cca73b68621f6b535b/users/b7770428a090476ca00cf90b52954beb/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:50.757586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.760029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:50.766917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.767513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.767810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.790282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba67f-914d-4ff3-ba87-322158987683 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.801664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] MFA Rules not processed for user `b7770428a090476ca00cf90b52954beb`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:50.803021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:50.869374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:50.879457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.881366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.881823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.882067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] PATH_INFO: `/v3/projects/c27e643eb6614763b4c6a16fc355dffb` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.884346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27e643eb6614763b4c6a16fc355dffb)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.888733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.905238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1031/2048] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:50.905238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:50.906728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:50.942624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85691597-aa2e-46be-881e-cb57a1dbb8d8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:50.951668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:50.952906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:50.952906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:50.953101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] PATH_INFO: `/v3/projects/2d255269dd834883b8b06e594fd4b5da` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:50.954497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d255269dd834883b8b06e594fd4b5da)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:50.956535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:50.986518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27e643eb6614763b4c6a16fc355dffb', 'request_id': 'req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:50.994956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27e643eb6614763b4c6a16fc355dffb', 'request_id': 'req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.004071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27e643eb6614763b4c6a16fc355dffb', 'request_id': 'req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.008504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:51.016507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d255269dd834883b8b06e594fd4b5da', 'request_id': 'req-a27afb1f-4afc-4d21-883b-95848234552a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.025457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] The token cache is being invalidate because project c27e643eb6614763b4c6a16fc355dffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:51.026071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.027452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.029414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d255269dd834883b8b06e594fd4b5da', 'request_id': 'req-a27afb1f-4afc-4d21-883b-95848234552a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.033776 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1018/2049] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:50 2022] DELETE /identity/v3/projects/c27e643eb6614763b4c6a16fc355dffb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:51.037537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.039362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d255269dd834883b8b06e594fd4b5da', 'request_id': 'req-a27afb1f-4afc-4d21-883b-95848234552a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.041298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.079796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] The token cache is being invalidate because project 2d255269dd834883b8b06e594fd4b5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:51.080472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.081559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a27afb1f-4afc-4d21-883b-95848234552a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.085357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1032/2050] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:50 2022] DELETE /identity/v3/projects/2d255269dd834883b8b06e594fd4b5da => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:51.087233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0bb60-7c1c-4ee8-a600-0e1432e44762 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.088258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0bb60-7c1c-4ee8-a600-0e1432e44762 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.089384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0bb60-7c1c-4ee8-a600-0e1432e44762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.128629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-fdf0bb60-7c1c-4ee8-a600-0e1432e44762 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:51.130133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fdf0bb60-7c1c-4ee8-a600-0e1432e44762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.167595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b69b-8819-44d5-aa38-2fc31ece4b7c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.210886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1033/2051] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:51.212092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943542e-e65d-44c6-b6dc-b3aca86d5c3d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.212388 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943542e-e65d-44c6-b6dc-b3aca86d5c3d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.212665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943542e-e65d-44c6-b6dc-b3aca86d5c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.237332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1943542e-e65d-44c6-b6dc-b3aca86d5c3d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:51.238782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1943542e-e65d-44c6-b6dc-b3aca86d5c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.240010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.241152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.241152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.241496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.243413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.257425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1034/2052] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:51.259025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37c23-ef09-453a-a9e8-293d0e5c4eea None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.259310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37c23-ef09-453a-a9e8-293d0e5c4eea None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.259594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37c23-ef09-453a-a9e8-293d0e5c4eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.291444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7cb37c23-ef09-453a-a9e8-293d0e5c4eea None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:51.291444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7cb37c23-ef09-453a-a9e8-293d0e5c4eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.305270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1035/2053] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:51.305270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88ac3b-eca5-413a-876f-2c9e363e14a4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.305270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88ac3b-eca5-413a-876f-2c9e363e14a4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.305270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88ac3b-eca5-413a-876f-2c9e363e14a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.328295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-be88ac3b-eca5-413a-876f-2c9e363e14a4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:51.329513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-be88ac3b-eca5-413a-876f-2c9e363e14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.333704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.335535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.349647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1036/2054] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:51.350559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88ac3b-eca5-413a-876f-2c9e363e14a4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.356459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1019/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:51.357499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.362876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88ac3b-eca5-413a-876f-2c9e363e14a4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.366845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.367934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.368214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.368485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.369220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:51.369477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.371208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.373522 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aaeaf-c36f-43f3-859b-773498603f07 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.386632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.387490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.387870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.391916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1037/2056] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:51.392239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.392239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:51.392371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.392441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.392441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.393167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.408963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1020/2057] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:51.408963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.409226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b591555-087a-4b92-9688-89dd231ec44f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.411905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.412570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.412853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.413132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] PATH_INFO: `/v3/users/b7770428a090476ca00cf90b52954beb` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.414406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7770428a090476ca00cf90b52954beb)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.416334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.419782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317727c8-574a-40ab-b9e6-fdc11c16c232 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.424694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.425347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.425635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.425911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.426616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.428618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.464880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1021/2058] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:51.464880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.473144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:51.494309 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7770428a090476ca00cf90b52954beb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.495184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7770428a090476ca00cf90b52954beb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.507655 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7770428a090476ca00cf90b52954beb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.517673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:51.543262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7770428a090476ca00cf90b52954beb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.568655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda6452-795c-4e5b-a388-8a9b9578afd1 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.572808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7770428a090476ca00cf90b52954beb'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:51.579602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7213fa-766f-4587-acd7-5294510a1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.580490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7213fa-766f-4587-acd7-5294510a1a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.580789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7213fa-766f-4587-acd7-5294510a1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.581192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7213fa-766f-4587-acd7-5294510a1a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.582024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7213fa-766f-4587-acd7-5294510a1a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.590700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7213fa-766f-4587-acd7-5294510a1a0e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.593176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1038/2059] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:51 2022] DELETE /identity/v3/users/b7770428a090476ca00cf90b52954beb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:51.598046 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.599764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.639250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1022/2060] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:51.639250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.639250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.639250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.665960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:51.665960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.733438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42e1b0-b2d7-4ffe-a383-2565eeae2674 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.839497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1023/2061] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:51.840481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.841972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.854222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dc927-b46c-4a3a-9d37-4414be5e715c None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.860173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.860542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.860675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.860960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.861147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.861317 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.861646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.861899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.862018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.862652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.864082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.864745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.885561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1024/2062] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:51.886983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.887243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1039/2063] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:51 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:51.889570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.890063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:51.900193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591976f2-a79b-421a-bbcb-4db78e7071f1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.905760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.906412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.906696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.907088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.907782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.909408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.921212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1040/2064] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:51.921212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.932893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274c21-e47e-4fd4-9882-c6c957e989e4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.938787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.939385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.939663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.939938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.940642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.942465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.951230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220604d-96f8-409b-9dc8-7ddf0dcfcbf4 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.954990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1041/2065] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:51.955130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.955687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.955884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.955995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.956233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.966705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.968182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.968373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494c1d-7775-4c92-9ead-c67ef882d6d5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.973085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.973685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.973963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.974255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.974960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.976538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:51.978184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1025/2066] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:51.978817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.987403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1042/2067] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:51.988822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d205-9f35-493e-b58e-9002c4d51f86 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:51.991353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:51.993786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:51.994427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:51.994711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:51.995020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:51.995953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:51.998130 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.001327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f98b2c-be98-4d6f-8ddd-b44b93cb61b1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.006383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95676da6-85c3-4842-8751-97f401f40da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.007051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676da6-85c3-4842-8751-97f401f40da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.007331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676da6-85c3-4842-8751-97f401f40da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.007605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676da6-85c3-4842-8751-97f401f40da1 admin admin] PATH_INFO: `/v3/projects/231684927cff4f7481e97e0c6cb10e62/users/cf681a87bd30494595c0c219c43528b1/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.010835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1026/2068] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:52.015226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.023344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:52.028978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340d463-22a9-460e-a669-eb170cf9fda6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.029658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95676da6-85c3-4842-8751-97f401f40da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231684927cff4f7481e97e0c6cb10e62, user_id=cf681a87bd30494595c0c219c43528b1, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.033303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95676da6-85c3-4842-8751-97f401f40da1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.041394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b7ead-8621-4ad4-ae3c-28640cbc6198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.042972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7ead-8621-4ad4-ae3c-28640cbc6198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.043313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7ead-8621-4ad4-ae3c-28640cbc6198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.043705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b7ead-8621-4ad4-ae3c-28640cbc6198 admin admin] PATH_INFO: `/v3/projects/a69c24f127994fc4a6e15139155e7d57/users/67b0f2fc29c74e569d19aad7c3d6a4b5/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.061093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1043/2069] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:51 2022] PUT /identity/v3/projects/231684927cff4f7481e97e0c6cb10e62/users/cf681a87bd30494595c0c219c43528b1/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:52.061304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b7ead-8621-4ad4-ae3c-28640cbc6198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69c24f127994fc4a6e15139155e7d57, user_id=67b0f2fc29c74e569d19aad7c3d6a4b5, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.062659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.063073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.063180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b7ead-8621-4ad4-ae3c-28640cbc6198 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.063562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.082854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1027/2070] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:52 2022] PUT /identity/v3/projects/a69c24f127994fc4a6e15139155e7d57/users/67b0f2fc29c74e569d19aad7c3d6a4b5/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:52.093783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e6eaa-1787-4a4a-8288-422677e8b4eb None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.094016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e6eaa-1787-4a4a-8288-422677e8b4eb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.094344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e6eaa-1787-4a4a-8288-422677e8b4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.099729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] MFA Rules not processed for user `cf681a87bd30494595c0c219c43528b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:52.105966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:52.113681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:52.130478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fe7e6eaa-1787-4a4a-8288-422677e8b4eb None None] MFA Rules not processed for user `67b0f2fc29c74e569d19aad7c3d6a4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:52.132004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fe7e6eaa-1787-4a4a-8288-422677e8b4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:52.204544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1044/2071] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:52.217478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.223601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:52.225096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1028/2072] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:16:52.229310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e6eaa-1787-4a4a-8288-422677e8b4eb None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.300540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba76585-9890-431d-be84-4cc6a0f875a2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.304219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e6eaa-1787-4a4a-8288-422677e8b4eb None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.305994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.308532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.308977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.309253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.320791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.321533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.321827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.322106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.322647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.323980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.325002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.326920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.335178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1045/2073] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:52.347843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.349728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:52.389394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0893-5448-479e-b748-87564c39c057 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.404035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1029/2074] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:52.407363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.407986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.408435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.408673 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.409244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] PATH_INFO: `/v3/projects/b13184f6f51b47cca73b68621f6b535b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.411535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13184f6f51b47cca73b68621f6b535b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.422050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.491082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13184f6f51b47cca73b68621f6b535b', 'request_id': 'req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:52.504640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13184f6f51b47cca73b68621f6b535b', 'request_id': 'req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:52.508148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20610f4-a575-4123-a235-2c5b5df07def admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.514102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13184f6f51b47cca73b68621f6b535b', 'request_id': 'req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:52.528991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] The token cache is being invalidate because project b13184f6f51b47cca73b68621f6b535b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:52.529544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:52.530720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-513ea7c0-1c03-4f48-8162-4d3a3bdd103b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:52.536092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1046/2075] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:52 2022] DELETE /identity/v3/projects/b13184f6f51b47cca73b68621f6b535b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:52.538186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a570-ac66-4c2d-8cf4-f4c03dedf7fd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.538536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a570-ac66-4c2d-8cf4-f4c03dedf7fd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.538813 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a570-ac66-4c2d-8cf4-f4c03dedf7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.540361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:52.567417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:52.593377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.594110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.594485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.594911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.595820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.598169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.602979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0244a570-ac66-4c2d-8cf4-f4c03dedf7fd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:52.604352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0244a570-ac66-4c2d-8cf4-f4c03dedf7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:52.614540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1047/2076] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:52.624502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b017-56f9-44af-a1f9-206f7eb8350a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.624502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b017-56f9-44af-a1f9-206f7eb8350a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.624777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b017-56f9-44af-a1f9-206f7eb8350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.633915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1030/2077] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:16:52.639415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.642418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:52.657259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3694b017-56f9-44af-a1f9-206f7eb8350a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:52.659316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3694b017-56f9-44af-a1f9-206f7eb8350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:52.669471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e8369-ed8c-4179-8996-68053e904872 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.678624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1048/2078] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:52.680460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694b017-56f9-44af-a1f9-206f7eb8350a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.685307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.686018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.686389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.686820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.690993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.696187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.696349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694b017-56f9-44af-a1f9-206f7eb8350a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.703807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.704586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.704670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.704964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.705662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:52.705964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.707929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.708901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1031/2079] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:52.712951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.726472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc7e0-e674-4d3e-bba5-8dbf8c8b9287 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.726679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1049/2080] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:52.728240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.740843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f5ae-db2c-4442-85e3-fdc285bd60f4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.741617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.743809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.744422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.745560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] PATH_INFO: `/v3/projects/31a53f00ff1a461793c3d392166a49ac/users/546d50ae2eed462cbd8072dcc9debe14/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.748763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.749446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.749820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.750212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.751009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.753792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.769207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a53f00ff1a461793c3d392166a49ac, user_id=546d50ae2eed462cbd8072dcc9debe14, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.773357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:52.789738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1032/2081] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:52 2022] PUT /identity/v3/projects/31a53f00ff1a461793c3d392166a49ac/users/546d50ae2eed462cbd8072dcc9debe14/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:52.792865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1050/2082] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:52.797097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.798025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:52.959512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778de6e7-4d95-4098-afbf-21aa134eeefc admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.976596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75cdf-8324-4d38-a12e-5778d0173785 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:52.982272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:52.982823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:52.983104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:52.983371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:52.984048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:52.986705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.012793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1051/2083] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:52 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:53.017185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:53.032520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc89d5-fe02-4c45-b069-6d652fd82cc2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:53.038965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:53.039336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:53.040018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.040297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.040505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.040628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.041068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.041283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:53.042260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.043371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:53.043486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.045234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.054059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1033/2084] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:53.058435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:53.061285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1052/2085] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:53.064727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:53.071306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1a173-d1c7-4218-b3f3-0b7ea27f1ca5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:53.076026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b976d9-bf8f-42d6-99f6-d6799afa4bf8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:53.076230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:53.076860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.077140 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.077415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] PATH_INFO: `/v3/projects/31a53f00ff1a461793c3d392166a49ac/users/546d50ae2eed462cbd8072dcc9debe14/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.079916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a53f00ff1a461793c3d392166a49ac, user_id=546d50ae2eed462cbd8072dcc9debe14, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:53.081045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3e8ed-1603-481f-a71e-85bf98a03fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:53.081659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e8ed-1603-481f-a71e-85bf98a03fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.081934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e8ed-1603-481f-a71e-85bf98a03fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.082200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e8ed-1603-481f-a71e-85bf98a03fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.082617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.082924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3e8ed-1603-481f-a71e-85bf98a03fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:53.084490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3e8ed-1603-481f-a71e-85bf98a03fe9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.095071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1034/2086] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:53 2022] PUT /identity/v3/projects/31a53f00ff1a461793c3d392166a49ac/users/546d50ae2eed462cbd8072dcc9debe14/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:53.099459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1053/2087] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:16:53.106659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:53.110222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.110534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.110946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.123726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:53.142609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] MFA Rules not processed for user `546d50ae2eed462cbd8072dcc9debe14`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:53.144016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:53.209387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b077cd-033b-41fb-8fae-41dbd34621b6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:53.215232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570e7ed-91ef-4f54-bfbc-9773b3918899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:53.216102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570e7ed-91ef-4f54-bfbc-9773b3918899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.216557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570e7ed-91ef-4f54-bfbc-9773b3918899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.216836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570e7ed-91ef-4f54-bfbc-9773b3918899 admin admin] PATH_INFO: `/v3/projects/d917f99492e64a95bf14541926735295/users/b21f82d93d6242fe8dcdc26ad6da71ed/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.232797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570e7ed-91ef-4f54-bfbc-9773b3918899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d917f99492e64a95bf14541926735295, user_id=b21f82d93d6242fe8dcdc26ad6da71ed, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:53.235548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570e7ed-91ef-4f54-bfbc-9773b3918899 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.246941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1054/2088] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:53.252825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1035/2089] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:53 2022] PUT /identity/v3/projects/d917f99492e64a95bf14541926735295/users/b21f82d93d6242fe8dcdc26ad6da71ed/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:16:53.254731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:53.256383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:53.265484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.265768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.266041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.268797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:53.299014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] MFA Rules not processed for user `b21f82d93d6242fe8dcdc26ad6da71ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:53.300257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:53.324544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f8542-34d2-41f0-a0cc-f0c80b272912 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:53.369461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1036/2090] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:53.381438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:53.382066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.382325 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:53.382425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.382635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.383704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:53.384443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:53.447555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a042dbc-97f8-41c3-bd09-be0d9cebf57d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:53.451330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:53.451448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff5fdc-d644-48fa-ad1d-7a95b2decc57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:53.452013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5fdc-d644-48fa-ad1d-7a95b2decc57 service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:53.452294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5fdc-d644-48fa-ad1d-7a95b2decc57 service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:53.452565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5fdc-d644-48fa-ad1d-7a95b2decc57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:53.452782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.464051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff5fdc-d644-48fa-ad1d-7a95b2decc57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:53.464638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1055/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:53.469064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff5fdc-d644-48fa-ad1d-7a95b2decc57 service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:53.484647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1037/2092] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:16:55.798657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:55.806628 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:55.901914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c221e3-d98a-4a6b-8317-aeb6afe51342 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:55.907418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:55.908156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:55.908526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:55.908871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] PATH_INFO: `/v3/users/cf681a87bd30494595c0c219c43528b1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:55.910192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf681a87bd30494595c0c219c43528b1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:55.912295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:55.938598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:55.970484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf681a87bd30494595c0c219c43528b1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:55.971180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf681a87bd30494595c0c219c43528b1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:55.981909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf681a87bd30494595c0c219c43528b1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:55.990999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf681a87bd30494595c0c219c43528b1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:56.008054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf681a87bd30494595c0c219c43528b1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:56.014940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1056/2093] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:16:55 2022] DELETE /identity/v3/users/cf681a87bd30494595c0c219c43528b1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:56.019393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:56.020280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:56.020547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:56.040564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:56.042755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:56.075497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:56.124558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1038/2094] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:56.177915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:56.180693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:56.266797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c8f91-d6f1-4a2e-ad48-9dc0c0b8ab3b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:56.270957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e94e75-8666-4f45-87f2-8975414aa150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:56.272736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94e75-8666-4f45-87f2-8975414aa150 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:56.272736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94e75-8666-4f45-87f2-8975414aa150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:56.272940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94e75-8666-4f45-87f2-8975414aa150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:56.286717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e94e75-8666-4f45-87f2-8975414aa150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:56.288177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e94e75-8666-4f45-87f2-8975414aa150 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:56.299362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1057/2095] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:57.235951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:57.238693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:57.260040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68cdb-ac62-42e4-8f2f-b8f673f03389 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:57.275744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:57.278601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:57.278601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:57.281136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] PATH_INFO: `/v3/projects/231684927cff4f7481e97e0c6cb10e62` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:57.284681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231684927cff4f7481e97e0c6cb10e62)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:57.288372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:57.447936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231684927cff4f7481e97e0c6cb10e62', 'request_id': 'req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:57.455525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231684927cff4f7481e97e0c6cb10e62', 'request_id': 'req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:57.468282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231684927cff4f7481e97e0c6cb10e62', 'request_id': 'req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:57.511385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] The token cache is being invalidate because project 231684927cff4f7481e97e0c6cb10e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:16:57.512649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:57.523652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-db7cd36e-4cf1-4f55-a349-f5adfc6748e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:16:57.525333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1039/2096] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:16:57 2022] DELETE /identity/v3/projects/231684927cff4f7481e97e0c6cb10e62 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:57.530171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bea4-1e7c-4c4b-84ae-1666b7fb4508 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:57.530739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bea4-1e7c-4c4b-84ae-1666b7fb4508 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:57.530739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04bea4-1e7c-4c4b-84ae-1666b7fb4508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:57.571680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7d04bea4-1e7c-4c4b-84ae-1666b7fb4508 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:57.573273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7d04bea4-1e7c-4c4b-84ae-1666b7fb4508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:57.646529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1058/2097] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:57.649452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7800bd-9d75-447b-9770-194308e79af2 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:57.650033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7800bd-9d75-447b-9770-194308e79af2 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:57.650401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7800bd-9d75-447b-9770-194308e79af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:57.671636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7c7800bd-9d75-447b-9770-194308e79af2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:57.672962 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7c7800bd-9d75-447b-9770-194308e79af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:57.681544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1040/2098] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:57.687668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04bea4-1e7c-4c4b-84ae-1666b7fb4508 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:57.704474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04bea4-1e7c-4c4b-84ae-1666b7fb4508 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:57.711709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:57.712690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:57.712975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:57.713995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:57.715171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:16:57.715467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:57.717732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:57.749089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1059/2099] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:16:57.753687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7800bd-9d75-447b-9770-194308e79af2 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:57.766068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7800bd-9d75-447b-9770-194308e79af2 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:57.774569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:57.775736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:57.777003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:57.777289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:57.777977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:57.781816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:57.825351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1041/2100] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:16:57 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:57.829470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:57.843853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89188ad7-ce07-4851-a123-ec98f14ed6a2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:57.877401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:57.923077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:57.923856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:57.924138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:57.924409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:57.925145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:57.927164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:57.951298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1060/2101] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:16:57 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:16:57.955352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:57.967637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fdffe-2f99-486c-b593-67b927348b6f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:57.972628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:57.973341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:57.973627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:57.973904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:57.974739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:57.976451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:57.992584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1042/2102] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:57.994893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:58.006962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d3fb-c020-477b-a3bf-02394e82a0b1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:58.011775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd48d68-adfc-4703-8ba0-15ac289ac06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:58.012451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48d68-adfc-4703-8ba0-15ac289ac06a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:58.012674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48d68-adfc-4703-8ba0-15ac289ac06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:58.012943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48d68-adfc-4703-8ba0-15ac289ac06a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:58.013644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd48d68-adfc-4703-8ba0-15ac289ac06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:58.015492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd48d68-adfc-4703-8ba0-15ac289ac06a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:58.030471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1061/2103] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:16:58.031926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:58.044294 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb270d-b039-4a89-bb93-1d6d27f1ad38 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:58.054782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:58.055804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:58.056292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:58.056774 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] PATH_INFO: `/v3/projects/d4c86f58c47846488d13ee9e6cd919b4/users/8b7553c2342444dc8fb4958ebf556fcd/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:58.085989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c86f58c47846488d13ee9e6cd919b4, user_id=8b7553c2342444dc8fb4958ebf556fcd, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:58.089975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:58.107601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1043/2104] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:16:58 2022] PUT /identity/v3/projects/d4c86f58c47846488d13ee9e6cd919b4/users/8b7553c2342444dc8fb4958ebf556fcd/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:16:58.118954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:58.119311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:58.119701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:58.171776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] MFA Rules not processed for user `8b7553c2342444dc8fb4958ebf556fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:16:58.173109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:58.279441 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1062/2105] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:16:58.498805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:58.501802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:58.594887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:58.599761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972ed0f-e002-472a-b893-c74f91f8e9e0 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:58.608030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:58.610270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:58.610555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:58.610832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:58.649618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:58.651367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:58.697464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1044/2106] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:16:58.766722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:16:58.768161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:58.842739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa187d4-96b8-4f89-874a-b627b06d9b54 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:16:58.847222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a9941-bce4-423d-85f4-dd28ad783574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:16:58.848118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9941-bce4-423d-85f4-dd28ad783574 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:16:58.848402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9941-bce4-423d-85f4-dd28ad783574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:16:58.848676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9941-bce4-423d-85f4-dd28ad783574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:16:58.850529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-802a9941-bce4-423d-85f4-dd28ad783574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:16:58.907594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:16:58.927940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a9941-bce4-423d-85f4-dd28ad783574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:16:58.929680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a9941-bce4-423d-85f4-dd28ad783574 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:16:58.942055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1063/2107] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:16:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:05.196330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:05.197836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:05.271899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c575c-a07e-40cd-847c-b9c985335357 service glance] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:05.280044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:05.281129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:05.281414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:05.281690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] PATH_INFO: `/v3/users/67b0f2fc29c74e569d19aad7c3d6a4b5` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:05.282986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b0f2fc29c74e569d19aad7c3d6a4b5)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:05.285028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:05.345521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b0f2fc29c74e569d19aad7c3d6a4b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:05.345891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b0f2fc29c74e569d19aad7c3d6a4b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:05.354271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b0f2fc29c74e569d19aad7c3d6a4b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:05.357432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b0f2fc29c74e569d19aad7c3d6a4b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:05.373047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b0f2fc29c74e569d19aad7c3d6a4b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:05.390352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1045/2108] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:05 2022] DELETE /identity/v3/users/67b0f2fc29c74e569d19aad7c3d6a4b5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:05.395061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:05.395560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:05.395661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:05.415584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:05.416891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:05.485704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1064/2109] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:05.497545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:05.499108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:05.565744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1145-5707-4a65-be81-cf5779c0b552 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:05.569261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:05.570007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:05.570429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:05.570808 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:05.581435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:05.582977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:05.593518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1046/2110] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:05.969107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:05.970590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:05.985012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcfded-597d-4b04-8224-8f1d914f9cda None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:05.989689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:05.990798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:05.991095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:05.991566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] PATH_INFO: `/v3/projects/a69c24f127994fc4a6e15139155e7d57` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:05.992752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69c24f127994fc4a6e15139155e7d57)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:05.994680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:06.059961 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69c24f127994fc4a6e15139155e7d57', 'request_id': 'req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.067393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69c24f127994fc4a6e15139155e7d57', 'request_id': 'req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.073092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69c24f127994fc4a6e15139155e7d57', 'request_id': 'req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.084122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] The token cache is being invalidate because project a69c24f127994fc4a6e15139155e7d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:06.084415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.085061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.086667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1065/2111] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:05 2022] DELETE /identity/v3/projects/a69c24f127994fc4a6e15139155e7d57 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:06.090901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:06.101976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed82d9a-9bce-41b4-aaba-192e84f62d85 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:06.112262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:06.163246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:06.164240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:06.164622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:06.164917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] PATH_INFO: `/v3/users/546d50ae2eed462cbd8072dcc9debe14` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:06.166089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=546d50ae2eed462cbd8072dcc9debe14)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:06.168099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:06.219256 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546d50ae2eed462cbd8072dcc9debe14'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.220187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546d50ae2eed462cbd8072dcc9debe14'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.228722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546d50ae2eed462cbd8072dcc9debe14'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.229371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546d50ae2eed462cbd8072dcc9debe14'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.242505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8de941aa-cbb5-46ef-b483-22d391fc57ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546d50ae2eed462cbd8072dcc9debe14'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.259074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1047/2112] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:06 2022] DELETE /identity/v3/users/546d50ae2eed462cbd8072dcc9debe14 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:17:06.770355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:06.772821 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:06.795040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca1ae9-3f5b-44de-ae52-ae6bf5d9d1d3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:06.902649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:06.903268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:06.903543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:06.903812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] PATH_INFO: `/v3/projects/31a53f00ff1a461793c3d392166a49ac` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:06.905041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a53f00ff1a461793c3d392166a49ac)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:06.907023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:06.920947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:06.959795 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a53f00ff1a461793c3d392166a49ac', 'request_id': 'req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.968079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a53f00ff1a461793c3d392166a49ac', 'request_id': 'req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.973850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a53f00ff1a461793c3d392166a49ac', 'request_id': 'req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.986297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] The token cache is being invalidate because project 31a53f00ff1a461793c3d392166a49ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:06.986589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.987247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ee22d7e0-b7e5-4c8e-bb88-1f30e82a3345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:06.988778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1066/2113] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:06 2022] DELETE /identity/v3/projects/31a53f00ff1a461793c3d392166a49ac => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:06.994740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02274911-9a99-48e6-839e-3d8ffa7c95ea None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:06.995032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02274911-9a99-48e6-839e-3d8ffa7c95ea None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:06.995314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02274911-9a99-48e6-839e-3d8ffa7c95ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.015268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-02274911-9a99-48e6-839e-3d8ffa7c95ea None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:07.016465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-02274911-9a99-48e6-839e-3d8ffa7c95ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:07.080287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1048/2114] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:07.088626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc50b-4899-4f6e-913d-79dbbd0a5b5c None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.088909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc50b-4899-4f6e-913d-79dbbd0a5b5c None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.089180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bc50b-4899-4f6e-913d-79dbbd0a5b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.111394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e19bc50b-4899-4f6e-913d-79dbbd0a5b5c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:07.112612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e19bc50b-4899-4f6e-913d-79dbbd0a5b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:07.123554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1067/2115] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:07.127847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02274911-9a99-48e6-839e-3d8ffa7c95ea None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.138527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02274911-9a99-48e6-839e-3d8ffa7c95ea None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.143374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.143987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.144515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.144786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.145479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:17:07.146008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.147944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.160904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1049/2116] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:17:07.165408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bc50b-4899-4f6e-913d-79dbbd0a5b5c None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.175078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bc50b-4899-4f6e-913d-79dbbd0a5b5c None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.179846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.180445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.180718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.180987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.181643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.183598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.210030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1068/2117] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:07 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:07.214201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.224809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd527f-8e56-4e33-9fe3-cc255bce3b5b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.242412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:07.285135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.285758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.286042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.286330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.287020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.288927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.313404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1050/2118] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:07 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:07.315535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.325620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521c7d9-f696-44f4-9cdf-2b7bca70c2d9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.330207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.330836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.331120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.331393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.332122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.333776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.346851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1069/2119] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:07.351062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.364478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc11f4-ee00-47ee-94b0-5d4c461ad995 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.369541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9741f-cec6-4805-96c2-61aed67ac566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.370165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9741f-cec6-4805-96c2-61aed67ac566 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.370475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9741f-cec6-4805-96c2-61aed67ac566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.370748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9741f-cec6-4805-96c2-61aed67ac566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.371475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9741f-cec6-4805-96c2-61aed67ac566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.373087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9741f-cec6-4805-96c2-61aed67ac566 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.384206 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1051/2120] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:07.388659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.398654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23113a71-565e-4b16-a088-a745b31ad143 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.403899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.404550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.404829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.405103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] PATH_INFO: `/v3/projects/5fe34d23709d4c628ffa4e6126e06fb8/users/3352c4e601d1486991100df087d71283/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.421209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe34d23709d4c628ffa4e6126e06fb8, user_id=3352c4e601d1486991100df087d71283, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.424498 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.439708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1070/2121] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:07 2022] PUT /identity/v3/projects/5fe34d23709d4c628ffa4e6126e06fb8/users/3352c4e601d1486991100df087d71283/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:17:07.451662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb8da-f645-4a82-93ce-0b5bc699b948 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.451953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb8da-f645-4a82-93ce-0b5bc699b948 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.452238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb8da-f645-4a82-93ce-0b5bc699b948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.480343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-baafb8da-f645-4a82-93ce-0b5bc699b948 None None] MFA Rules not processed for user `3352c4e601d1486991100df087d71283`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:07.481634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-baafb8da-f645-4a82-93ce-0b5bc699b948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:07.556310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1052/2122] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:17:07.560845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.628320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f47783-59a2-4ea0-b935-5c2c530e6b61 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.633287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.633901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.634209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.634514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.635183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.637602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.666262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1071/2123] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:07 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:07.670431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafb8da-f645-4a82-93ce-0b5bc699b948 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.681174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafb8da-f645-4a82-93ce-0b5bc699b948 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.746375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.747522 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.747803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.748077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.748755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.750726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.775833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1053/2124] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:07 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:07.780072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.796457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aac1f-95bb-4030-bd17-4864c70c1c3c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.811621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.812407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.812712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.812984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.813720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.815392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.827327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1072/2125] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:07.831308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.842967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd92d1-e0df-4120-ae92-36f5b8118fb0 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.847952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6be2-11f3-4dd7-bd5b-66ef965603b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.848714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6be2-11f3-4dd7-bd5b-66ef965603b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.849118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6be2-11f3-4dd7-bd5b-66ef965603b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.849422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6be2-11f3-4dd7-bd5b-66ef965603b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.850181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa6be2-11f3-4dd7-bd5b-66ef965603b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.851978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa6be2-11f3-4dd7-bd5b-66ef965603b6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.864800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1054/2126] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:17:07.869157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:07.880578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435cb80-6feb-406e-8920-31d0ae8e245b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:07.890014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:07.890736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.891013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.891278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] PATH_INFO: `/v3/projects/aff83110ed9f45b6bf0114e6ec3d46b0/users/def2e123b51c4c3898dbd656de692c44/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.904143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:07.916258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff83110ed9f45b6bf0114e6ec3d46b0, user_id=def2e123b51c4c3898dbd656de692c44, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:07.920582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:07.934283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1073/2127] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:07 2022] PUT /identity/v3/projects/aff83110ed9f45b6bf0114e6ec3d46b0/users/def2e123b51c4c3898dbd656de692c44/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:07.945257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67b0e-ad52-4b30-a2d4-f853c534f9b1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:07.945553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67b0e-ad52-4b30-a2d4-f853c534f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:07.945832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67b0e-ad52-4b30-a2d4-f853c534f9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:07.960441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:07.978686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-eab67b0e-ad52-4b30-a2d4-f853c534f9b1 None None] MFA Rules not processed for user `def2e123b51c4c3898dbd656de692c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:07.980156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-eab67b0e-ad52-4b30-a2d4-f853c534f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:08.058814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1055/2128] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:08.059737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:08.136844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bbd2-a5ce-480f-bd52-318a5d170076 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:08.143976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:08.145085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.145519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.146425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.148352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:08.151152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:08.191336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1074/2129] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:08 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:08.194556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67b0e-ad52-4b30-a2d4-f853c534f9b1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:08.205737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67b0e-ad52-4b30-a2d4-f853c534f9b1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:08.260822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:08.261540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.261831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.262672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.263326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:08.265254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:08.286152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1056/2130] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:08 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:08.290593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:08.302330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef6d14-6947-4b28-8780-04c60babbccd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:08.306978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:08.307587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.307867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.308134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.308915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:08.311487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:08.322079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1075/2131] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:17:08.326933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:08.337558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafc0f-8402-4c63-8548-112f504f13a8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:08.343466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:08.344311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.344726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.345044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] PATH_INFO: `/v3/projects/ebc6f44cac4b4f41b6977431f8569ad4/users/947eb8937b1941c392be84cde59dc6f1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.360694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc6f44cac4b4f41b6977431f8569ad4, user_id=947eb8937b1941c392be84cde59dc6f1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:08.363500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:08.376440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1057/2132] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:08 2022] PUT /identity/v3/projects/ebc6f44cac4b4f41b6977431f8569ad4/users/947eb8937b1941c392be84cde59dc6f1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:17:08.380550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:08.398024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372325-e2d5-48b4-b9c0-a1bae04558dc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:08.457127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96802841-2a03-400b-bafc-c5afbdf12541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:08.457751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96802841-2a03-400b-bafc-c5afbdf12541 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.458030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96802841-2a03-400b-bafc-c5afbdf12541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.458331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96802841-2a03-400b-bafc-c5afbdf12541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.459027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96802841-2a03-400b-bafc-c5afbdf12541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:08.460623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96802841-2a03-400b-bafc-c5afbdf12541 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:08.471243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1076/2133] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:08.475528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:08.488731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d087-181d-4958-88aa-dbcee20b0fad admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:08.493530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:08.494201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.494508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.494786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] PATH_INFO: `/v3/projects/ebc6f44cac4b4f41b6977431f8569ad4/users/947eb8937b1941c392be84cde59dc6f1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.497331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc6f44cac4b4f41b6977431f8569ad4, user_id=947eb8937b1941c392be84cde59dc6f1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:08.500015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:08.510938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1058/2134] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:08 2022] PUT /identity/v3/projects/ebc6f44cac4b4f41b6977431f8569ad4/users/947eb8937b1941c392be84cde59dc6f1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:08.521062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260e4a-f6a7-4e18-ae70-6302935394d0 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.521427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260e4a-f6a7-4e18-ae70-6302935394d0 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.521707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260e4a-f6a7-4e18-ae70-6302935394d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.550256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f4260e4a-f6a7-4e18-ae70-6302935394d0 None None] MFA Rules not processed for user `947eb8937b1941c392be84cde59dc6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:08.551494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f4260e4a-f6a7-4e18-ae70-6302935394d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:08.601592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:08.632060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1077/2135] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:08.639417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:08.641220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:08.699844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:08.704792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c28fc-834e-42bf-a4a3-409d527c2d8c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:08.709955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:08.710616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:08.710897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:08.711166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:08.772807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:08.774262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:08.784231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1059/2136] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:10.346476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4260e4a-f6a7-4e18-ae70-6302935394d0 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:10.355984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4260e4a-f6a7-4e18-ae70-6302935394d0 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:10.359791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3aa11-a5f3-4ff3-ab15-11b3174096b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:10.360398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3aa11-a5f3-4ff3-ab15-11b3174096b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:10.360766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3aa11-a5f3-4ff3-ab15-11b3174096b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:10.361095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3aa11-a5f3-4ff3-ab15-11b3174096b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:10.425980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3aa11-a5f3-4ff3-ab15-11b3174096b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:10.427474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3aa11-a5f3-4ff3-ab15-11b3174096b8 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:10.438420 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1078/2137] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:11.124422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:11.132254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb210c-2f6e-4c1d-b394-0eb31f07100f service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:11.136797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210c8d8-0121-41fb-a1e9-5ca9649a352c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:11.137992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c8d8-0121-41fb-a1e9-5ca9649a352c service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:11.138313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c8d8-0121-41fb-a1e9-5ca9649a352c service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:11.138592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c8d8-0121-41fb-a1e9-5ca9649a352c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:11.154211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210c8d8-0121-41fb-a1e9-5ca9649a352c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:11.156081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210c8d8-0121-41fb-a1e9-5ca9649a352c service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:11.167154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1060/2138] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:17:13.081234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b696-d977-4702-b753-4daebd293b5f None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.081700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b696-d977-4702-b753-4daebd293b5f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.081858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b696-d977-4702-b753-4daebd293b5f None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.083603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1079/2139] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:17:13.112596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.113039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.113147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.140970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:13.140970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:13.163754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b696-d977-4702-b753-4daebd293b5f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:13.165785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a999b696-d977-4702-b753-4daebd293b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:13.214260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1061/2140] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:17:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:13.226954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:13.229673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:13.244993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc966-b2fe-4420-a626-8301ced48574 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:13.250257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:13.250887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.251170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.251446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.251582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b696-d977-4702-b753-4daebd293b5f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:13.256742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:13.257446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.257789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.258143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] PATH_INFO: `/v3/users/a1bbb2e1b2b146659c23e9b51e3a6fee` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.259428 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1bbb2e1b2b146659c23e9b51e3a6fee)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:13.260625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:13.261524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:13.262887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:13.272610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1062/2141] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:17:13.308509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1bbb2e1b2b146659c23e9b51e3a6fee'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.309726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1bbb2e1b2b146659c23e9b51e3a6fee'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.317407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1bbb2e1b2b146659c23e9b51e3a6fee'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.325115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1bbb2e1b2b146659c23e9b51e3a6fee'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.337086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0a39cd43-254c-49fd-a553-d972f916fb81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1bbb2e1b2b146659c23e9b51e3a6fee'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.339171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:13.345496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1080/2142] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:13 2022] DELETE /identity/v3/users/a1bbb2e1b2b146659c23e9b51e3a6fee => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:17:13.526783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:13.546929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685dda8-4ca6-4611-a37f-cafa6445815b service placement] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:13.605209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:13.606419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.606700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.606973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] PATH_INFO: `/v3/projects/33ee2ca0d7714ef0acee6e379ab89ce4` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.608132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ee2ca0d7714ef0acee6e379ab89ce4)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:13.610038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:13.625865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:13.658043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ee2ca0d7714ef0acee6e379ab89ce4', 'request_id': 'req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.664155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ee2ca0d7714ef0acee6e379ab89ce4', 'request_id': 'req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.670928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ee2ca0d7714ef0acee6e379ab89ce4', 'request_id': 'req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.683525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] The token cache is being invalidate because project 33ee2ca0d7714ef0acee6e379ab89ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:13.684446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.685120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a3ea01c5-13b9-4de0-9e43-401d1f322cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:13.686909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1063/2143] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:13 2022] DELETE /identity/v3/projects/33ee2ca0d7714ef0acee6e379ab89ce4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:13.692414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f29aea-4524-41d1-b698-7f7ca9cb1688 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.693001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f29aea-4524-41d1-b698-7f7ca9cb1688 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.693001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f29aea-4524-41d1-b698-7f7ca9cb1688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.715321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-63f29aea-4524-41d1-b698-7f7ca9cb1688 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:13.716620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-63f29aea-4524-41d1-b698-7f7ca9cb1688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:13.784561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1081/2144] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:13.794710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cd83c-c7b5-4444-ad52-ae39686663d7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.795044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cd83c-c7b5-4444-ad52-ae39686663d7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.795386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cd83c-c7b5-4444-ad52-ae39686663d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.816309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ee2cd83c-c7b5-4444-ad52-ae39686663d7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:13.817537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ee2cd83c-c7b5-4444-ad52-ae39686663d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:13.825993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1064/2145] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:13.829952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f29aea-4524-41d1-b698-7f7ca9cb1688 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:13.843811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f29aea-4524-41d1-b698-7f7ca9cb1688 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:13.849116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:13.850034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.850342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.850625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.851321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:17:13.851630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:13.853211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:13.870181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1082/2146] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:17:13.871415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cd83c-c7b5-4444-ad52-ae39686663d7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:13.881503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cd83c-c7b5-4444-ad52-ae39686663d7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:13.886573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:13.887307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:13.887649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:13.887990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:13.889017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:13.891115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:13.921983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1065/2147] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:13 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:13.926324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:13.936617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c87811-6070-4240-bbda-e74c9c86564f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:14.001546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:14.002173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:14.002476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:14.002744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:14.003407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:14.005315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:14.029685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1083/2148] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:13 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:14.031015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:14.044777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ffb55-9663-40e0-9684-322a4ca72560 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:14.050877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:14.051511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:14.051796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:14.052072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:14.052778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:14.054469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:14.078287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1066/2149] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:14.085097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:14.095705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237527-c03f-41db-90c7-6017ba692dcc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:14.100465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df498304-ac78-468f-a77b-2ac465567a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:14.101086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498304-ac78-468f-a77b-2ac465567a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:14.101372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498304-ac78-468f-a77b-2ac465567a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:14.101652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498304-ac78-468f-a77b-2ac465567a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:14.102392 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df498304-ac78-468f-a77b-2ac465567a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:14.104002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df498304-ac78-468f-a77b-2ac465567a5c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:14.115538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1084/2150] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:14.119759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:14.131109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68b08-2726-4f43-aa84-ac504312851f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:14.139930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:14.140623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:14.140906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:14.141238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] PATH_INFO: `/v3/projects/b5b6a48bdf6a49319e4faf2a502b7586/users/d5ad25c3f42e4ac2ad52592d55f94bb8/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:14.162747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b6a48bdf6a49319e4faf2a502b7586, user_id=d5ad25c3f42e4ac2ad52592d55f94bb8, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:14.165657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:14.184563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1067/2151] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:14 2022] PUT /identity/v3/projects/b5b6a48bdf6a49319e4faf2a502b7586/users/d5ad25c3f42e4ac2ad52592d55f94bb8/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:14.189643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:14.189944 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:14.190204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:14.216226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:14.217112 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:14.281406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1085/2152] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:14.298571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:14.298571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:14.353607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800876d-6364-4f71-82ca-11fe079b03cd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:14.357881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e858d-db13-45e4-953f-e8b1017f9f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:14.358524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e858d-db13-45e4-953f-e8b1017f9f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:14.358812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e858d-db13-45e4-953f-e8b1017f9f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:14.359086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e858d-db13-45e4-953f-e8b1017f9f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:14.368479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e858d-db13-45e4-953f-e8b1017f9f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:14.370115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e858d-db13-45e4-953f-e8b1017f9f5f service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:14.382545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1068/2153] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:15.369836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:15.371340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:15.388295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6115b-31d2-4d85-b204-a5aed1ab41ae None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:15.393576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:15.394278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:15.394787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:15.395278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] PATH_INFO: `/v3/users/3352c4e601d1486991100df087d71283` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:15.397598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3352c4e601d1486991100df087d71283)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:15.399827 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:15.405582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:15.455608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3352c4e601d1486991100df087d71283'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:15.456334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3352c4e601d1486991100df087d71283'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:15.468852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3352c4e601d1486991100df087d71283'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:15.477979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3352c4e601d1486991100df087d71283'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:15.494623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3352c4e601d1486991100df087d71283'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:15.502936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1086/2154] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:15 2022] DELETE /identity/v3/users/3352c4e601d1486991100df087d71283 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:15.507722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:15.508629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:15.509240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:15.531523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:15.532861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:15.580618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:15.608492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1069/2155] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:17:15.622056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:15.623625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:15.718039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fa629-ad90-4e58-8934-464166739866 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:15.723621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:15.724225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:15.725162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:15.725575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:15.740642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:15.742557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:15.754192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1087/2156] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:16.244110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:16.245685 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:16.267673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113d6fc-1cbb-4f03-b637-9580abd5c9d6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:16.275611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:16.276574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:16.276574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:16.276806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] PATH_INFO: `/v3/projects/5fe34d23709d4c628ffa4e6126e06fb8` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:16.279342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe34d23709d4c628ffa4e6126e06fb8)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:16.281587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:16.387967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe34d23709d4c628ffa4e6126e06fb8', 'request_id': 'req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.405243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe34d23709d4c628ffa4e6126e06fb8', 'request_id': 'req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.411717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe34d23709d4c628ffa4e6126e06fb8', 'request_id': 'req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.439401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] The token cache is being invalidate because project 5fe34d23709d4c628ffa4e6126e06fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:16.439800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.440771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.443004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1070/2157] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:16 2022] DELETE /identity/v3/projects/5fe34d23709d4c628ffa4e6126e06fb8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:16.446756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:16.466130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46005326-04e9-42c4-96f8-b699e20b4db1 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:16.549488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:16.550332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:16.550712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:16.551217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] PATH_INFO: `/v3/users/def2e123b51c4c3898dbd656de692c44` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:16.552805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def2e123b51c4c3898dbd656de692c44)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:16.554888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:16.591703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:16.617400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def2e123b51c4c3898dbd656de692c44'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.618051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def2e123b51c4c3898dbd656de692c44'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.626712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def2e123b51c4c3898dbd656de692c44'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.638008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def2e123b51c4c3898dbd656de692c44'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.653366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def2e123b51c4c3898dbd656de692c44'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:16.660521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1088/2158] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:16 2022] DELETE /identity/v3/users/def2e123b51c4c3898dbd656de692c44 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:17:17.173657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:17.175141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:17.203364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcf37-9ad0-4554-b8f6-2e16b0ce0d8e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:17.286590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:17.287450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:17.287763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:17.288139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] PATH_INFO: `/v3/projects/aff83110ed9f45b6bf0114e6ec3d46b0` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:17.289671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff83110ed9f45b6bf0114e6ec3d46b0)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:17.291733 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:17.377975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff83110ed9f45b6bf0114e6ec3d46b0', 'request_id': 'req-262ff3bf-275a-4e71-a55a-3282aed4aeb4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.398270 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff83110ed9f45b6bf0114e6ec3d46b0', 'request_id': 'req-262ff3bf-275a-4e71-a55a-3282aed4aeb4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.406981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff83110ed9f45b6bf0114e6ec3d46b0', 'request_id': 'req-262ff3bf-275a-4e71-a55a-3282aed4aeb4'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.418940 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:17.436865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] The token cache is being invalidate because project aff83110ed9f45b6bf0114e6ec3d46b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:17.437586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.439056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.440920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1071/2159] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:17 2022] DELETE /identity/v3/projects/aff83110ed9f45b6bf0114e6ec3d46b0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:17.446867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:17.450335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:17.477492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ad84-11cd-4ae9-b686-ffe011120601 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:17.568914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:17.569623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:17.569913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:17.570371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] PATH_INFO: `/v3/users/947eb8937b1941c392be84cde59dc6f1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:17.581136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947eb8937b1941c392be84cde59dc6f1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:17.583371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:17.670473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947eb8937b1941c392be84cde59dc6f1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.671165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947eb8937b1941c392be84cde59dc6f1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.684974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947eb8937b1941c392be84cde59dc6f1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.705216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947eb8937b1941c392be84cde59dc6f1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.718549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-aa5f5c96-e51f-4b53-a1c8-ec3ca6426151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947eb8937b1941c392be84cde59dc6f1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:17.725868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1089/2160] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:17 2022] DELETE /identity/v3/users/947eb8937b1941c392be84cde59dc6f1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:18.195034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:18.196694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:18.229799 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ff3bf-275a-4e71-a55a-3282aed4aeb4 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:18.311301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:18.312059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:18.312906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:18.313264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] PATH_INFO: `/v3/projects/ebc6f44cac4b4f41b6977431f8569ad4` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:18.314750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc6f44cac4b4f41b6977431f8569ad4)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:18.316756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:18.390388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc6f44cac4b4f41b6977431f8569ad4', 'request_id': 'req-28d7f6e0-226f-495c-ad02-03be463e4146'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:18.399120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc6f44cac4b4f41b6977431f8569ad4', 'request_id': 'req-28d7f6e0-226f-495c-ad02-03be463e4146'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:18.407009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc6f44cac4b4f41b6977431f8569ad4', 'request_id': 'req-28d7f6e0-226f-495c-ad02-03be463e4146'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:18.430700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] The token cache is being invalidate because project ebc6f44cac4b4f41b6977431f8569ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:18.431029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:18.431902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28d7f6e0-226f-495c-ad02-03be463e4146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:18.433929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1072/2161] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:18 2022] DELETE /identity/v3/projects/ebc6f44cac4b4f41b6977431f8569ad4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:18.440057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775aa5b-4449-4f18-940c-f141d6511bd4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:18.440374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775aa5b-4449-4f18-940c-f141d6511bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:18.440654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775aa5b-4449-4f18-940c-f141d6511bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:18.479157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9775aa5b-4449-4f18-940c-f141d6511bd4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:18.482609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9775aa5b-4449-4f18-940c-f141d6511bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:18.527024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:18.626970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1090/2162] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:18.703492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2affad-b270-46e7-91b2-27f98905ea67 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:18.703769 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2affad-b270-46e7-91b2-27f98905ea67 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:18.704215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2affad-b270-46e7-91b2-27f98905ea67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:18.726883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3b2affad-b270-46e7-91b2-27f98905ea67 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:18.729748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3b2affad-b270-46e7-91b2-27f98905ea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:18.739450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1073/2163] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:17:18.743776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775aa5b-4449-4f18-940c-f141d6511bd4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:18.756185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775aa5b-4449-4f18-940c-f141d6511bd4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:18.762517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:18.763362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:18.763844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:18.768185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:18.769178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:17:18.770746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:18.772975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:18.797930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2affad-b270-46e7-91b2-27f98905ea67 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:18.804156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1091/2164] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:17:18.811667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2affad-b270-46e7-91b2-27f98905ea67 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:18.845092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:18.845736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:18.846015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:18.846322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:18.847000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:18.848959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:18.927957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1074/2165] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:18 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:18.932128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:18.942793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06acbb-6243-4628-b319-13db2bf1b35b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:19.029381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:19.030358 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.030604 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.030876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.034712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:19.037099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:19.076169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1092/2166] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:18 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:19.081922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:19.094466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8375-fe1b-479e-9f8e-6d8508999d99 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:19.100730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:19.101540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.101825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.102092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.103009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:19.104651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:19.118467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1075/2167] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:19.119639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:19.130998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f563e-c890-45fb-a4b3-2ed2b80f9f99 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:19.145017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f08b8b-927d-4fbd-b1ef-59e80791bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:19.145825 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f08b8b-927d-4fbd-b1ef-59e80791bb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.145956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f08b8b-927d-4fbd-b1ef-59e80791bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.146330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f08b8b-927d-4fbd-b1ef-59e80791bb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.146937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f08b8b-927d-4fbd-b1ef-59e80791bb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:19.148588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f08b8b-927d-4fbd-b1ef-59e80791bb6d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:19.167467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1093/2168] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:19.168956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:19.179717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7a659-b160-490e-94fe-8fc7a4607a7c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:19.189713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71110694-1b25-4b74-ad99-9f2af1a712e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:19.190442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110694-1b25-4b74-ad99-9f2af1a712e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.190730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110694-1b25-4b74-ad99-9f2af1a712e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.191012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110694-1b25-4b74-ad99-9f2af1a712e9 admin admin] PATH_INFO: `/v3/projects/1a92f4c6670e4668a37963245471871b/users/c6f27a5bd8b14614a2652592ee0ac3ef/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.209847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71110694-1b25-4b74-ad99-9f2af1a712e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a92f4c6670e4668a37963245471871b, user_id=c6f27a5bd8b14614a2652592ee0ac3ef, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:19.213100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71110694-1b25-4b74-ad99-9f2af1a712e9 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:19.240778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1076/2169] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:19 2022] PUT /identity/v3/projects/1a92f4c6670e4668a37963245471871b/users/c6f27a5bd8b14614a2652592ee0ac3ef/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:19.246499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.253282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.253282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.290358 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:19.291601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:19.328275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.328797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.329267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.366643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] MFA Rules not processed for user `d5ad25c3f42e4ac2ad52592d55f94bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:19.368001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:19.380991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:19.398534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1094/2170] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:19.409031 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:19.411218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:19.449431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:19.454164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1077/2171] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:19.471348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:19.473075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:19.488547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9537c3c-1499-48e8-9e08-6c9ca516dfba None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:19.492587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220111b-d729-47f6-9275-fcadb728bfd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:19.493216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220111b-d729-47f6-9275-fcadb728bfd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.493494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220111b-d729-47f6-9275-fcadb728bfd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.493765 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220111b-d729-47f6-9275-fcadb728bfd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.504510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220111b-d729-47f6-9275-fcadb728bfd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:19.506301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220111b-d729-47f6-9275-fcadb728bfd8 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:19.517104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1095/2172] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:19.566029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeb122-a077-40b7-8ed1-33411c539416 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:19.572196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:19.572837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:19.573274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:19.573400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:19.582509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:19.585832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:19.598587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1078/2173] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:20.386318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32787bf-a052-4fed-b790-484d0cd90a31 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:20.386818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32787bf-a052-4fed-b790-484d0cd90a31 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:20.387224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32787bf-a052-4fed-b790-484d0cd90a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:20.450820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e32787bf-a052-4fed-b790-484d0cd90a31 None None] MFA Rules not processed for user `c6f27a5bd8b14614a2652592ee0ac3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:20.452447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e32787bf-a052-4fed-b790-484d0cd90a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:20.560254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1096/2174] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:20.571347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:20.573377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:20.666043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25410c30-e361-4374-99ec-3c8db9d83165 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:20.672807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc1630-3a65-456f-bcaa-83b3e2c1b79b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:20.673845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc1630-3a65-456f-bcaa-83b3e2c1b79b service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:20.674448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc1630-3a65-456f-bcaa-83b3e2c1b79b service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:20.675360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc1630-3a65-456f-bcaa-83b3e2c1b79b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:20.686498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc1630-3a65-456f-bcaa-83b3e2c1b79b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:20.688247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc1630-3a65-456f-bcaa-83b3e2c1b79b service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:20.703949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1079/2175] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:21.628243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:21.628702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:21.628804 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:21.651619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] MFA Rules not processed for user `d5ad25c3f42e4ac2ad52592d55f94bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:21.652882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:21.659822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1097/2176] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:22.234341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4097-863c-46ee-af52-3145c4e9c69f None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:22.235524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4097-863c-46ee-af52-3145c4e9c69f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:22.235828 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4097-863c-46ee-af52-3145c4e9c69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:22.275915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-487a4097-863c-46ee-af52-3145c4e9c69f None None] MFA Rules not processed for user `c6f27a5bd8b14614a2652592ee0ac3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:22.277448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-487a4097-863c-46ee-af52-3145c4e9c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:22.285887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1080/2177] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:29.609247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:29.610718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:29.628865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ccf22-71ce-405c-8713-d1f980d48552 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:29.633645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:29.634316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:29.634599 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:29.634872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] PATH_INFO: `/v3/users/367bc991a2ff4fe6b213929f5d3e1411` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:29.636034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] RBAC: Authorizing `identity:delete_user(user_id=367bc991a2ff4fe6b213929f5d3e1411)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:29.637964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:29.683316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367bc991a2ff4fe6b213929f5d3e1411'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:29.683891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367bc991a2ff4fe6b213929f5d3e1411'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:29.691895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367bc991a2ff4fe6b213929f5d3e1411'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:29.698882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367bc991a2ff4fe6b213929f5d3e1411'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:29.710651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367bc991a2ff4fe6b213929f5d3e1411'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:29.717021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1098/2178] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:29 2022] DELETE /identity/v3/users/367bc991a2ff4fe6b213929f5d3e1411 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:29.721529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:29.722005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:29.722097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:29.741267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:29.742523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:29.771780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:29.803214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1081/2179] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:29.812894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:29.814325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:29.842373 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:29.875459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce454-f15c-4f62-9481-8dff2966635e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:29.879098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde203d-5d07-4029-9414-61415c487db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:29.879704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde203d-5d07-4029-9414-61415c487db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:29.879979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde203d-5d07-4029-9414-61415c487db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:29.880250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde203d-5d07-4029-9414-61415c487db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:29.889284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde203d-5d07-4029-9414-61415c487db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:29.890763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde203d-5d07-4029-9414-61415c487db8 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:29.900238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1099/2180] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:30.401836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:30.403299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:30.420966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11ec8c-322e-4d4a-83b4-a2bcc09878dc None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:30.427525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:30.428196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.428667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.428937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] PATH_INFO: `/v3/projects/94c5f2e9ebd3436ea0f83f2762058af1` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.431304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c5f2e9ebd3436ea0f83f2762058af1)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:30.433742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:30.481771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c5f2e9ebd3436ea0f83f2762058af1', 'request_id': 'req-aec2d636-232d-41a7-a749-06fb2a9ad4fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:30.487784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c5f2e9ebd3436ea0f83f2762058af1', 'request_id': 'req-aec2d636-232d-41a7-a749-06fb2a9ad4fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:30.493298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c5f2e9ebd3436ea0f83f2762058af1', 'request_id': 'req-aec2d636-232d-41a7-a749-06fb2a9ad4fd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:30.508887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] The token cache is being invalidate because project 94c5f2e9ebd3436ea0f83f2762058af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:30.509210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:30.509800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-aec2d636-232d-41a7-a749-06fb2a9ad4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:30.511447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1082/2181] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:30 2022] DELETE /identity/v3/projects/94c5f2e9ebd3436ea0f83f2762058af1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:30.516775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2733-98c3-4fae-9b0a-24e4328400a5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.517130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2733-98c3-4fae-9b0a-24e4328400a5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.517475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2733-98c3-4fae-9b0a-24e4328400a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.537224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-df5d2733-98c3-4fae-9b0a-24e4328400a5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:30.538570 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-df5d2733-98c3-4fae-9b0a-24e4328400a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:30.607080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1100/2182] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:30.609607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ce455-3783-4bd5-8e01-59a674626d14 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.609607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ce455-3783-4bd5-8e01-59a674626d14 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.609853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ce455-3783-4bd5-8e01-59a674626d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.632141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c19ce455-3783-4bd5-8e01-59a674626d14 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:30.633631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c19ce455-3783-4bd5-8e01-59a674626d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:30.646042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1083/2183] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:30.650627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2733-98c3-4fae-9b0a-24e4328400a5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:30.667626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2733-98c3-4fae-9b0a-24e4328400a5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:30.667626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:30.667626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.667626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.667995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.668245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:17:30.668552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:30.670867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:30.687314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1101/2184] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:17:30.688464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ce455-3783-4bd5-8e01-59a674626d14 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:30.707944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ce455-3783-4bd5-8e01-59a674626d14 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:30.712706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:30.713331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.713616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.713946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.714719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:30.716745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:30.748424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1084/2185] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:30 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:30.749510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:30.759948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b291c-2c3c-4112-9c03-acf1e358378b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:30.819571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:30.820189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.820468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.820737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.821426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:30.823363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:30.849786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1102/2186] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:30 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:17:30.853929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:30.864646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab3924-0036-4ebd-a4ca-3ec2f8ee9d99 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:30.869986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:30.870791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.871574 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.871846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.872539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:30.874155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:30.884506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1085/2187] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:30.889573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:30.901574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f53308-ebf5-4cee-b9a0-b77793f499f8 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:30.906341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae2b12-db8a-4be1-823a-8aa0a26b9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:30.906952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2b12-db8a-4be1-823a-8aa0a26b9896 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.907236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2b12-db8a-4be1-823a-8aa0a26b9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.907512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2b12-db8a-4be1-823a-8aa0a26b9896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.908226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae2b12-db8a-4be1-823a-8aa0a26b9896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:30.909788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae2b12-db8a-4be1-823a-8aa0a26b9896 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:30.920800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1103/2188] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:30.924955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:30.935523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6361-93ed-4821-9d6f-08054a113cf6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:30.940250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:30.940830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.941109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.941382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] PATH_INFO: `/v3/projects/c9062f19db464255a851915b7d7f8d0c/users/6cf050b670304e18a70d1165c8d83054/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:30.956128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9062f19db464255a851915b7d7f8d0c, user_id=6cf050b670304e18a70d1165c8d83054, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:30.958888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:30.972350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1086/2189] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:30 2022] PUT /identity/v3/projects/c9062f19db464255a851915b7d7f8d0c/users/6cf050b670304e18a70d1165c8d83054/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:30.983416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393e3f-800e-4a3b-ba67-8673fd190524 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:30.983612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393e3f-800e-4a3b-ba67-8673fd190524 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:30.983887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393e3f-800e-4a3b-ba67-8673fd190524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.011801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-91393e3f-800e-4a3b-ba67-8673fd190524 None None] MFA Rules not processed for user `6cf050b670304e18a70d1165c8d83054`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:31.012946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-91393e3f-800e-4a3b-ba67-8673fd190524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:31.033141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:31.077914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1104/2190] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:31.082622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.138928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:31.150926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e819e-23b8-4662-b6bf-17ed5ebe3bb4 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.157917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.158707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.158987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.159261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.159918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.161833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.189339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1087/2191] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:31 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:31.193455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393e3f-800e-4a3b-ba67-8673fd190524 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.204390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393e3f-800e-4a3b-ba67-8673fd190524 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.261954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.262518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.262796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.263066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.264016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.265745 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.288877 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1105/2192] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:31 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:31.293012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.308411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0109-13fe-490d-a32f-867314c57bac admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.313315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.313927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.314204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.314509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.315219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.316805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.327621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1088/2193] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:31.331465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.341786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af181465-63a7-48fc-8c35-36d5b227fe7d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.346396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d55ab-d605-4bd4-a5c2-56637c4a60aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.346979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d55ab-d605-4bd4-a5c2-56637c4a60aa admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.347257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d55ab-d605-4bd4-a5c2-56637c4a60aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.347525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d55ab-d605-4bd4-a5c2-56637c4a60aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.348205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d55ab-d605-4bd4-a5c2-56637c4a60aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.349805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d55ab-d605-4bd4-a5c2-56637c4a60aa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.360062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1106/2194] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:31.364057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.374034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f9f21-6ca0-48c1-a24b-d85878febead admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.378785 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.379487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.380034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.380034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] PATH_INFO: `/v3/projects/46c66d54a508450aaed6483cebbd7672/users/29b8828c0323486abfa0249649c8b38a/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.396051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c66d54a508450aaed6483cebbd7672, user_id=29b8828c0323486abfa0249649c8b38a, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.398800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.418968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1089/2195] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:31 2022] PUT /identity/v3/projects/46c66d54a508450aaed6483cebbd7672/users/29b8828c0323486abfa0249649c8b38a/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:31.430429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0e48b-ffdb-4036-8774-287ded585055 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.430802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0e48b-ffdb-4036-8774-287ded585055 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.431165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0e48b-ffdb-4036-8774-287ded585055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.459536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-68b0e48b-ffdb-4036-8774-287ded585055 None None] MFA Rules not processed for user `29b8828c0323486abfa0249649c8b38a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:31.460738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-68b0e48b-ffdb-4036-8774-287ded585055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:31.528850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1107/2196] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:31.533554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.602360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9c325-2654-4d76-8c81-660c27774533 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.609389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.609675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.609953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.610242 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.611189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.613443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.641141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1090/2197] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:31 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:31.645173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0e48b-ffdb-4036-8774-287ded585055 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.656571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0e48b-ffdb-4036-8774-287ded585055 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.687083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:31.721075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.721777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.722122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.722526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.723283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.725275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.756562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1108/2198] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:31 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:31.757335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.769108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9ca7-46da-42dc-a8fd-4a0a799c6013 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.773978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.774578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.774859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.775134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.775839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.778040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.793771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1091/2199] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:31.795016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.808784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb6233-6bfb-43d2-a6e5-053b56f9b27c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.816762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.817596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.818259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.818685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] PATH_INFO: `/v3/projects/eeadde758fee497c8af4e189b598dd0b/users/15eecd7235d94124a1b17e7b377ecc75/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.837020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeadde758fee497c8af4e189b598dd0b, user_id=15eecd7235d94124a1b17e7b377ecc75, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.840797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.862402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1109/2200] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:31 2022] PUT /identity/v3/projects/eeadde758fee497c8af4e189b598dd0b/users/15eecd7235d94124a1b17e7b377ecc75/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:31.866875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.886086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420fbeb-beed-4566-979c-bde81e33ca8f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:31.966075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384379a8-33b8-4196-8e6e-d48c7d4c5b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:31.966075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384379a8-33b8-4196-8e6e-d48c7d4c5b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:31.966495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384379a8-33b8-4196-8e6e-d48c7d4c5b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:31.966663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384379a8-33b8-4196-8e6e-d48c7d4c5b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:31.967320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384379a8-33b8-4196-8e6e-d48c7d4c5b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:31.969004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384379a8-33b8-4196-8e6e-d48c7d4c5b98 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:31.980215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1092/2201] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:31.984368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:31.995124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e506cb-6f8e-4549-aac3-aabaf9033fe3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:32.000311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:32.000963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:32.001240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:32.001508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] PATH_INFO: `/v3/projects/eeadde758fee497c8af4e189b598dd0b/users/15eecd7235d94124a1b17e7b377ecc75/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:32.003460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeadde758fee497c8af4e189b598dd0b, user_id=15eecd7235d94124a1b17e7b377ecc75, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:32.006351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:32.017039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1110/2202] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:31 2022] PUT /identity/v3/projects/eeadde758fee497c8af4e189b598dd0b/users/15eecd7235d94124a1b17e7b377ecc75/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:32.027244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b2a70-4108-4058-bdb4-e9c4ab2eced1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:32.027454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b2a70-4108-4058-bdb4-e9c4ab2eced1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:32.027729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b2a70-4108-4058-bdb4-e9c4ab2eced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:32.052041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:32.055301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-5e8b2a70-4108-4058-bdb4-e9c4ab2eced1 None None] MFA Rules not processed for user `15eecd7235d94124a1b17e7b377ecc75`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:32.056969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5e8b2a70-4108-4058-bdb4-e9c4ab2eced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:32.124097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1093/2203] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:32.136023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:32.138421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:32.193927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9182c-cac4-44a4-bfef-2e26c00b1f17 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:32.197529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:32.198130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:32.198433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:32.199250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:32.253137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:32.254586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:32.263760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1111/2204] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:33.769203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b2a70-4108-4058-bdb4-e9c4ab2eced1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:33.778772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b2a70-4108-4058-bdb4-e9c4ab2eced1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:33.782361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:33.782978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:33.783260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:33.783532 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:33.839049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:33.840551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:33.849899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1094/2205] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:34.473752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:34.475296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:34.486524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ee934-6c50-4b72-9b30-26cac515b7a5 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:34.490067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419523-7a37-40c0-b579-a4ec41efc1b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:34.490700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419523-7a37-40c0-b579-a4ec41efc1b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:34.490980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419523-7a37-40c0-b579-a4ec41efc1b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:34.491250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419523-7a37-40c0-b579-a4ec41efc1b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:34.500085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419523-7a37-40c0-b579-a4ec41efc1b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:34.501484 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419523-7a37-40c0-b579-a4ec41efc1b7 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:34.511049 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1112/2206] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:38.467119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:38.533497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdfc06-d94e-4eca-8a5c-549fd0530410 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:38.539017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:38.539668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:38.539955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:38.540259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] PATH_INFO: `/v3/users/6cf050b670304e18a70d1165c8d83054` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:38.541435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf050b670304e18a70d1165c8d83054)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:38.544102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:38.586299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:38.593927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf050b670304e18a70d1165c8d83054'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:38.594603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf050b670304e18a70d1165c8d83054'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:38.601756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf050b670304e18a70d1165c8d83054'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:38.602448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf050b670304e18a70d1165c8d83054'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:38.615067 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf050b670304e18a70d1165c8d83054'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:38.628198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1095/2207] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:38 2022] DELETE /identity/v3/users/6cf050b670304e18a70d1165c8d83054 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:38.632907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:38.633384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:38.633477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:38.652550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:38.653689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:38.672650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:38.713431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1113/2208] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:38.723721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:38.725167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:38.783115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8520d-c600-4ca0-87a4-04ab08904cfd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:38.786945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:38.787613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:38.787897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:38.788174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:38.799545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:38.800996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:38.811990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1096/2209] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:39.123292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:39.124803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:39.138796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6bf60-3613-4ec8-a812-0a51f740d045 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:39.145816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:39.146566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:39.146872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:39.147161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] PATH_INFO: `/v3/projects/c9062f19db464255a851915b7d7f8d0c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:39.151690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9062f19db464255a851915b7d7f8d0c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:39.154612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:39.230336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9062f19db464255a851915b7d7f8d0c', 'request_id': 'req-bdc79ca8-b936-489d-8a4a-a37528c50fdd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.238217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9062f19db464255a851915b7d7f8d0c', 'request_id': 'req-bdc79ca8-b936-489d-8a4a-a37528c50fdd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.246396 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9062f19db464255a851915b7d7f8d0c', 'request_id': 'req-bdc79ca8-b936-489d-8a4a-a37528c50fdd'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.264397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] The token cache is being invalidate because project c9062f19db464255a851915b7d7f8d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:39.264691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.265347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.269840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1114/2210] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:39 2022] DELETE /identity/v3/projects/c9062f19db464255a851915b7d7f8d0c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:39.270970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:39.282135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96240b3b-aa04-444f-a60d-3f0476d5910e service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:39.345369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:39.346020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:39.346338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:39.346616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] PATH_INFO: `/v3/users/29b8828c0323486abfa0249649c8b38a` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:39.347819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b8828c0323486abfa0249649c8b38a)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:39.349749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:39.400823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b8828c0323486abfa0249649c8b38a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.401503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b8828c0323486abfa0249649c8b38a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.408919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b8828c0323486abfa0249649c8b38a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.409851 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b8828c0323486abfa0249649c8b38a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.414924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:39.434425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b8828c0323486abfa0249649c8b38a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.454903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1097/2211] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:39 2022] DELETE /identity/v3/users/29b8828c0323486abfa0249649c8b38a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:39.764552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:39.766507 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:39.823057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc79ca8-b936-489d-8a4a-a37528c50fdd admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:39.924223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:39.924918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:39.925363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:39.925641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] PATH_INFO: `/v3/projects/46c66d54a508450aaed6483cebbd7672` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:39.929191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c66d54a508450aaed6483cebbd7672)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:39.931576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:39.987855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c66d54a508450aaed6483cebbd7672', 'request_id': 'req-08979739-6475-4338-a236-0ea3a250e050'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:39.989811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:39.999756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c66d54a508450aaed6483cebbd7672', 'request_id': 'req-08979739-6475-4338-a236-0ea3a250e050'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.008968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c66d54a508450aaed6483cebbd7672', 'request_id': 'req-08979739-6475-4338-a236-0ea3a250e050'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.021608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] The token cache is being invalidate because project 46c66d54a508450aaed6483cebbd7672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:40.022003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.022728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.024410 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1115/2212] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:39 2022] DELETE /identity/v3/projects/46c66d54a508450aaed6483cebbd7672 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:40.028456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:40.039459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:40.054207 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee353b6-4ec7-4fb9-8a63-a4275c46829f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:40.160882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:40.162031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:40.162432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:40.162852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] PATH_INFO: `/v3/users/15eecd7235d94124a1b17e7b377ecc75` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:40.165227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15eecd7235d94124a1b17e7b377ecc75)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:40.168204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:40.239268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15eecd7235d94124a1b17e7b377ecc75'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.240164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15eecd7235d94124a1b17e7b377ecc75'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.248578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15eecd7235d94124a1b17e7b377ecc75'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.249342 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15eecd7235d94124a1b17e7b377ecc75'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.279374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-bc62f57a-cf31-4ca4-8fcd-b8c8a5e7dd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15eecd7235d94124a1b17e7b377ecc75'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.303614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1098/2213] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:40 2022] DELETE /identity/v3/users/15eecd7235d94124a1b17e7b377ecc75 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:40.601243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:40.602941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:40.623200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979739-6475-4338-a236-0ea3a250e050 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:40.690159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:40.691127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:40.691127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:40.691348 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] PATH_INFO: `/v3/projects/eeadde758fee497c8af4e189b598dd0b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:40.695606 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeadde758fee497c8af4e189b598dd0b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:40.698076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:40.758435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeadde758fee497c8af4e189b598dd0b', 'request_id': 'req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.768535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeadde758fee497c8af4e189b598dd0b', 'request_id': 'req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.776476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeadde758fee497c8af4e189b598dd0b', 'request_id': 'req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.789975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] The token cache is being invalidate because project eeadde758fee497c8af4e189b598dd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:40.790295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.790956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-fcd56d1c-c308-4db8-b31b-8f8b78d1d9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:40.794947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1116/2214] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:40 2022] DELETE /identity/v3/projects/eeadde758fee497c8af4e189b598dd0b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:40.799970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854026c0-294a-4e97-bb19-521adc15b2d5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:40.800331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854026c0-294a-4e97-bb19-521adc15b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:40.800690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854026c0-294a-4e97-bb19-521adc15b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:40.821189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-854026c0-294a-4e97-bb19-521adc15b2d5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:40.822519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-854026c0-294a-4e97-bb19-521adc15b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:40.905941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:40.955792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1099/2215] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:17:40.965108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55cd3d-c3c8-4ec9-9095-5df4b6f558e5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:40.965399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55cd3d-c3c8-4ec9-9095-5df4b6f558e5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:40.965678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55cd3d-c3c8-4ec9-9095-5df4b6f558e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:40.996360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-fe55cd3d-c3c8-4ec9-9095-5df4b6f558e5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:40.997607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fe55cd3d-c3c8-4ec9-9095-5df4b6f558e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:41.007279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1117/2216] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:41.012219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854026c0-294a-4e97-bb19-521adc15b2d5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:41.023143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854026c0-294a-4e97-bb19-521adc15b2d5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:41.030971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:41.032334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.032688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.033029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.034811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:17:41.035665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:41.039686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:41.061303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55cd3d-c3c8-4ec9-9095-5df4b6f558e5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:41.070595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1100/2217] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:17:41.077299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55cd3d-c3c8-4ec9-9095-5df4b6f558e5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:41.086285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:41.087175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.087595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.088452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.089386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:41.091951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:41.131005 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1118/2218] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:41 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:41.140663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:41.149609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7f98-eda4-40e2-b846-41b539447a45 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:41.215200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:41.215834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.216106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.216379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.217041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:41.219011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:41.241900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1101/2219] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:41 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:41.246757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:41.258619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db2d33-8717-44e0-aa0c-17863c4c0163 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:41.264286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:41.265512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.265793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.266079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.266805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:41.268862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:41.280398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1119/2220] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:41.284423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:41.296858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf3761-d64c-4b7f-8662-729a9b8ec243 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:41.301508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4090-ec84-4632-905b-5ca2de14b693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:41.302146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4090-ec84-4632-905b-5ca2de14b693 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.302453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4090-ec84-4632-905b-5ca2de14b693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.302722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4090-ec84-4632-905b-5ca2de14b693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.303459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae4090-ec84-4632-905b-5ca2de14b693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:41.305065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae4090-ec84-4632-905b-5ca2de14b693 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:41.316390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1102/2221] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:41.320793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:41.331722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aa390-499b-4e03-bde7-4565128a0f0f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:41.337571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:41.338330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.338605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.338930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] PATH_INFO: `/v3/projects/6c12bd2673cc44f6a8d88b9b1d14bfac/users/02e70f9d1e064f34819aabf4dd9706e7/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.353679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c12bd2673cc44f6a8d88b9b1d14bfac, user_id=02e70f9d1e064f34819aabf4dd9706e7, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:41.357232 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:41.375134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1120/2222] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:41 2022] PUT /identity/v3/projects/6c12bd2673cc44f6a8d88b9b1d14bfac/users/02e70f9d1e064f34819aabf4dd9706e7/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:41.386880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.386880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.386880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.415582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] MFA Rules not processed for user `02e70f9d1e064f34819aabf4dd9706e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:41.416952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:41.495215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1103/2223] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:41.513325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:41.515132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:41.522494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:41.579036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9543135-71af-4fc8-b033-eb3302c6f62d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:41.582887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828683-cabd-47e4-844d-fdf81c0935f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:41.583511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828683-cabd-47e4-844d-fdf81c0935f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:41.583790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828683-cabd-47e4-844d-fdf81c0935f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:41.584059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828683-cabd-47e4-844d-fdf81c0935f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:41.593499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828683-cabd-47e4-844d-fdf81c0935f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:41.594975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828683-cabd-47e4-844d-fdf81c0935f5 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:41.606468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1121/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:17:42.532606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:42.534039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:42.586562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:42.600360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092593e-1551-4ea9-b984-3bc42246e756 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:42.605478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:42.606122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:42.606431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:42.606706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] PATH_INFO: `/v3/users/b21f82d93d6242fe8dcdc26ad6da71ed` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:42.607865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21f82d93d6242fe8dcdc26ad6da71ed)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:42.609778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:42.657456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21f82d93d6242fe8dcdc26ad6da71ed'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:42.658199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21f82d93d6242fe8dcdc26ad6da71ed'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:42.665469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21f82d93d6242fe8dcdc26ad6da71ed'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:42.666117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21f82d93d6242fe8dcdc26ad6da71ed'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:42.678568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21f82d93d6242fe8dcdc26ad6da71ed'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:42.692100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1104/2225] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:42 2022] DELETE /identity/v3/users/b21f82d93d6242fe8dcdc26ad6da71ed => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:42.696633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:42.697111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:42.697221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:42.716605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:42.717797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:42.776403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1122/2226] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:42.786412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:42.787809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:42.849764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8db7e8-2a88-4d92-b617-106dab6a77c5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:42.853897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f00d-20f7-40a1-b973-eac850a8dc87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:42.854581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f00d-20f7-40a1-b973-eac850a8dc87 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:42.855184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f00d-20f7-40a1-b973-eac850a8dc87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:42.855465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f00d-20f7-40a1-b973-eac850a8dc87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:42.870725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f00d-20f7-40a1-b973-eac850a8dc87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:42.872973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f00d-20f7-40a1-b973-eac850a8dc87 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:42.885398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1105/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:43.249463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:43.250916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:43.265221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dd5a1-9c73-4139-81e4-c669bb8e215b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:43.270556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:43.271368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.271656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.271944 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] PATH_INFO: `/v3/projects/d917f99492e64a95bf14541926735295` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.273905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d917f99492e64a95bf14541926735295)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:43.275265 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:43.363066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd917f99492e64a95bf14541926735295', 'request_id': 'req-76653385-fc7e-4db1-a6da-6ae836983688'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:43.374551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd917f99492e64a95bf14541926735295', 'request_id': 'req-76653385-fc7e-4db1-a6da-6ae836983688'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:43.385707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd917f99492e64a95bf14541926735295', 'request_id': 'req-76653385-fc7e-4db1-a6da-6ae836983688'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:43.404125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] The token cache is being invalidate because project d917f99492e64a95bf14541926735295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:43.404936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:43.406167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-76653385-fc7e-4db1-a6da-6ae836983688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:43.411975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1123/2228] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:43 2022] DELETE /identity/v3/projects/d917f99492e64a95bf14541926735295 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:43.413737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c2a8-0025-422a-b386-9dfd7019b6c8 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.414030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c2a8-0025-422a-b386-9dfd7019b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.414347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c2a8-0025-422a-b386-9dfd7019b6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.453496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2dc0c2a8-0025-422a-b386-9dfd7019b6c8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:43.455961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2dc0c2a8-0025-422a-b386-9dfd7019b6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:43.545484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1106/2229] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:43.553963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16f245-6861-4796-90f9-0b92a3fff262 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.554303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16f245-6861-4796-90f9-0b92a3fff262 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.554891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16f245-6861-4796-90f9-0b92a3fff262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.582371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8f16f245-6861-4796-90f9-0b92a3fff262 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:43.583791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8f16f245-6861-4796-90f9-0b92a3fff262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:43.604354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1124/2230] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:43.610058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c2a8-0025-422a-b386-9dfd7019b6c8 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:43.628156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c2a8-0025-422a-b386-9dfd7019b6c8 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:43.635266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:43.636356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.637985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.639524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.640718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:17:43.641364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:43.643977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:43.666581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1107/2231] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:17:43.667912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16f245-6861-4796-90f9-0b92a3fff262 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:43.682730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16f245-6861-4796-90f9-0b92a3fff262 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:43.696569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:43.697148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.697688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.697688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.698451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:43.702167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:43.760052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1125/2232] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:17:43 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:43.763822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:43.769645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:43.778195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174b53-7e23-4c43-b98f-e61645b30fc6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:43.844714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:43.845353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.845634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.845909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.846625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:43.848543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:43.870837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1108/2233] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:17:43 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:17:43.875109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:43.881603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:43.887663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51e36-6a39-4739-8dd7-c10fcd99b929 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:43.893307 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:43.893939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.894219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.894537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.895257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:43.896871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:43.907254 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1126/2234] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:17:43.911021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:43.921495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd783e-d385-4140-9039-03adf2a969bd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:43.926075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e82ab-9979-4daa-b90c-c30979729716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:43.926702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e82ab-9979-4daa-b90c-c30979729716 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.926980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e82ab-9979-4daa-b90c-c30979729716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.927247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e82ab-9979-4daa-b90c-c30979729716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.927927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e82ab-9979-4daa-b90c-c30979729716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:43.929512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e82ab-9979-4daa-b90c-c30979729716 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:43.941359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1109/2235] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:17:43.946425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:43.960697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fc68-8c7f-4434-87cd-0184a5bb53a4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:43.965964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:43.966672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:43.966950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:43.967219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] PATH_INFO: `/v3/projects/906c3b46041b45b79d90b378cdd4d320/users/e1a8c89e09c64000a6f3363f0eaf7b79/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:43.982029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906c3b46041b45b79d90b378cdd4d320, user_id=e1a8c89e09c64000a6f3363f0eaf7b79, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:43.984680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:43.997332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1127/2236] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:17:43 2022] PUT /identity/v3/projects/906c3b46041b45b79d90b378cdd4d320/users/e1a8c89e09c64000a6f3363f0eaf7b79/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:17:44.007650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:44.007932 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:44.008202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:44.038136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] MFA Rules not processed for user `e1a8c89e09c64000a6f3363f0eaf7b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:44.039661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:44.106697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1110/2237] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:44.116952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:44.118782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:44.178275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772f818-bdc2-4e76-9ea7-0411393a4e97 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:44.181929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a615e-0fe0-4cdb-82c2-c6bad31c6d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:44.182567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a615e-0fe0-4cdb-82c2-c6bad31c6d92 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:44.182845 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a615e-0fe0-4cdb-82c2-c6bad31c6d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:44.183111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a615e-0fe0-4cdb-82c2-c6bad31c6d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:44.191301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a615e-0fe0-4cdb-82c2-c6bad31c6d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:44.192708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a615e-0fe0-4cdb-82c2-c6bad31c6d92 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:44.201978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1128/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:45.918703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:45.920308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:45.995604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38d838-17bd-470f-8dc7-cba8f492ec6b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:46.000662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:46.001391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:46.001749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:46.002086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] PATH_INFO: `/v3/users/8b7553c2342444dc8fb4958ebf556fcd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:46.003427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7553c2342444dc8fb4958ebf556fcd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:46.005435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:46.022369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:46.070324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7553c2342444dc8fb4958ebf556fcd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.071125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7553c2342444dc8fb4958ebf556fcd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.079073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7553c2342444dc8fb4958ebf556fcd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.079750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7553c2342444dc8fb4958ebf556fcd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.097194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7553c2342444dc8fb4958ebf556fcd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.112556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1111/2239] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:45 2022] DELETE /identity/v3/users/8b7553c2342444dc8fb4958ebf556fcd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:46.116911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:46.117406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:46.117509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:46.145713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:46.147563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:46.212850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1129/2240] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:46.222587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:46.224119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:46.282744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4cce0-a05a-4c91-9172-9c55d55cce40 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:46.286532 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:46.287146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:46.287426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:46.287700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:46.296728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:46.298161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:46.308351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1112/2241] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:46.583711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:46.585145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:46.597678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adf3cf-53a0-4bd1-b574-d0388fc4d803 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:46.602529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:46.603343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:46.603627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:46.603892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] PATH_INFO: `/v3/projects/d4c86f58c47846488d13ee9e6cd919b4` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:46.605558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c86f58c47846488d13ee9e6cd919b4)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:46.607678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:46.654113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c86f58c47846488d13ee9e6cd919b4', 'request_id': 'req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.661247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c86f58c47846488d13ee9e6cd919b4', 'request_id': 'req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.666854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c86f58c47846488d13ee9e6cd919b4', 'request_id': 'req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.668479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:46.680842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] The token cache is being invalidate because project d4c86f58c47846488d13ee9e6cd919b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:46.681177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.682013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-cf6b0c63-87ca-4cb2-ac45-c3eb8f6216a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:46.684262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1130/2242] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:46 2022] DELETE /identity/v3/projects/d4c86f58c47846488d13ee9e6cd919b4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:54.471355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:54.472946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:54.486664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02379-dc91-4301-966a-bd88f8f1d8c8 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:54.543424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:54.544069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:54.544354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:54.544632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] PATH_INFO: `/v3/users/e1a8c89e09c64000a6f3363f0eaf7b79` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:54.545819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a8c89e09c64000a6f3363f0eaf7b79)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:54.547837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:54.584724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:17:54.596611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a8c89e09c64000a6f3363f0eaf7b79'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:54.597324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a8c89e09c64000a6f3363f0eaf7b79'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:54.604321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a8c89e09c64000a6f3363f0eaf7b79'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:54.605043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a8c89e09c64000a6f3363f0eaf7b79'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:54.616649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a8c89e09c64000a6f3363f0eaf7b79'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:54.629947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1113/2243] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:17:54 2022] DELETE /identity/v3/users/e1a8c89e09c64000a6f3363f0eaf7b79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:17:54.634680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:54.635235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:54.635235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:54.655230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:17:54.656449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:54.715056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1131/2244] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:17:54.724926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:54.726535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:54.785042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0650387-098a-4252-af7e-f1fe4f7071db admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:54.788741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f934286-1be4-4182-bea8-125d302eebad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:54.789366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f934286-1be4-4182-bea8-125d302eebad service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:54.789647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f934286-1be4-4182-bea8-125d302eebad service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:54.789921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f934286-1be4-4182-bea8-125d302eebad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:54.799519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f934286-1be4-4182-bea8-125d302eebad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:54.800969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f934286-1be4-4182-bea8-125d302eebad service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:54.810683 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1114/2245] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:17:55.113920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:17:55.115584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:17:55.145064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f947-c99b-4af8-b0d1-abd5bb2d762e None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:17:55.150909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:17:55.151858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:17:55.152137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:17:55.152406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] PATH_INFO: `/v3/projects/906c3b46041b45b79d90b378cdd4d320` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:17:55.153600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906c3b46041b45b79d90b378cdd4d320)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:17:55.156659 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:17:55.209194 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906c3b46041b45b79d90b378cdd4d320', 'request_id': 'req-c14eb09c-8f2c-489e-be97-3770dd8d0544'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:55.218350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906c3b46041b45b79d90b378cdd4d320', 'request_id': 'req-c14eb09c-8f2c-489e-be97-3770dd8d0544'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:55.225171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906c3b46041b45b79d90b378cdd4d320', 'request_id': 'req-c14eb09c-8f2c-489e-be97-3770dd8d0544'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:55.237816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] The token cache is being invalidate because project 906c3b46041b45b79d90b378cdd4d320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:17:55.238109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:55.238799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c14eb09c-8f2c-489e-be97-3770dd8d0544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:17:55.240323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1132/2246] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:17:55 2022] DELETE /identity/v3/projects/906c3b46041b45b79d90b378cdd4d320 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:18:04.806505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=42,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:18:05.234614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:18:17.163351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:17.163835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:17.163969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:17.183112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] MFA Rules not processed for user `aa550d74b152469e97d47b8ffdf7804a`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:17.184301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:17.241652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1115/2247] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:18:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:18:17.804459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b01c-789f-4afd-83ef-b8d71a42c9fe None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:17.804920 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b01c-789f-4afd-83ef-b8d71a42c9fe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:17.805114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b01c-789f-4afd-83ef-b8d71a42c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:17.824952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-dbe4b01c-789f-4afd-83ef-b8d71a42c9fe None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:17.826340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-dbe4b01c-789f-4afd-83ef-b8d71a42c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:17.898124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1133/2248] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:18:17.920880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:17.922314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:18.001606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e48da-92c5-418e-a114-1e6dec0f2950 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:18.007758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:18.008440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:18.008967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:18.009245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:18.018099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:18.019762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:18.029515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1116/2249] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:18:22.921177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:22.921694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:22.921796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:22.943395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:22.944711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:22.954153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1134/2250] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:18:22.976777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:22.978452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:22.994501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab127-23ad-4ce8-a590-31057af62c64 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:23.000923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827f997-25e9-4772-813e-04950b653375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:23.001454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827f997-25e9-4772-813e-04950b653375 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:23.001734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827f997-25e9-4772-813e-04950b653375 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:23.002001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827f997-25e9-4772-813e-04950b653375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:23.012280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827f997-25e9-4772-813e-04950b653375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:23.013964 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827f997-25e9-4772-813e-04950b653375 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:23.025666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1117/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:18:26.922742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:26.924318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:26.936862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f78ef-35ef-48d5-8f23-f5f77b119059 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:26.941461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:26.942098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:26.942399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:26.942671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] PATH_INFO: `/v3/users/02e70f9d1e064f34819aabf4dd9706e7` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:26.943824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e70f9d1e064f34819aabf4dd9706e7)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:26.945715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:26.995041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e70f9d1e064f34819aabf4dd9706e7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:26.995842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e70f9d1e064f34819aabf4dd9706e7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.003717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e70f9d1e064f34819aabf4dd9706e7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.011195 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e70f9d1e064f34819aabf4dd9706e7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.023180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e70f9d1e064f34819aabf4dd9706e7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.029510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1135/2252] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:18:26 2022] DELETE /identity/v3/users/02e70f9d1e064f34819aabf4dd9706e7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:18:27.033677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:27.034148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:27.034386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:27.058992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:27.060179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:27.117875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1118/2253] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:18:27.127492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:27.128880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:27.188572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f150684-7646-4ab3-a0c8-48688bf1d1dc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:27.192272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e5809-4959-4a96-9671-8f3d94b9a461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:27.192886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e5809-4959-4a96-9671-8f3d94b9a461 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:27.193163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e5809-4959-4a96-9671-8f3d94b9a461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:27.193434 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e5809-4959-4a96-9671-8f3d94b9a461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:27.202204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e5809-4959-4a96-9671-8f3d94b9a461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:27.203633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e5809-4959-4a96-9671-8f3d94b9a461 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:27.213331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1136/2254] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:18:27.485766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:27.487292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:27.499444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825727a-67ce-4ab5-a781-e06df42589f0 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:27.504608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:27.505513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:27.505801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:27.506071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] PATH_INFO: `/v3/projects/6c12bd2673cc44f6a8d88b9b1d14bfac` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:27.507268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c12bd2673cc44f6a8d88b9b1d14bfac)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:27.509193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:27.521538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:18:27.554900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c12bd2673cc44f6a8d88b9b1d14bfac', 'request_id': 'req-746fcae1-45e2-4483-af53-f3bfc5e81a91'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.560891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c12bd2673cc44f6a8d88b9b1d14bfac', 'request_id': 'req-746fcae1-45e2-4483-af53-f3bfc5e81a91'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.566870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c12bd2673cc44f6a8d88b9b1d14bfac', 'request_id': 'req-746fcae1-45e2-4483-af53-f3bfc5e81a91'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.578797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] The token cache is being invalidate because project 6c12bd2673cc44f6a8d88b9b1d14bfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:18:27.579079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.579711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:18:27.581250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1119/2255] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:18:27 2022] DELETE /identity/v3/projects/6c12bd2673cc44f6a8d88b9b1d14bfac => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:18:30.281968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059e71-cde5-45e6-a079-f95ff8030432 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:30.282833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059e71-cde5-45e6-a079-f95ff8030432 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:30.282833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e059e71-cde5-45e6-a079-f95ff8030432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:30.305433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2e059e71-cde5-45e6-a079-f95ff8030432 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:30.306733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2e059e71-cde5-45e6-a079-f95ff8030432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:30.311645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:18:30.370173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1137/2256] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:18:30.393025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:30.394529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:30.469930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fcae1-45e2-4483-af53-f3bfc5e81a91 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:30.475975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:30.476599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:30.476874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:30.477144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:30.485845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:30.487459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:30.497537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1120/2257] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:18:35.409191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b052fd-e84b-4929-b6ce-415e644dd9e4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:35.409680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b052fd-e84b-4929-b6ce-415e644dd9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:35.409903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b052fd-e84b-4929-b6ce-415e644dd9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:35.434187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-05b052fd-e84b-4929-b6ce-415e644dd9e4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:35.435435 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-05b052fd-e84b-4929-b6ce-415e644dd9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:35.443466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1138/2258] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:18:35.465244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:35.467552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:35.485209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc89e-6d28-44b9-83b5-b709d46eed3c service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:35.491300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:35.491992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:35.492211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:35.492479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:35.501528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:35.504441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:35.514279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1121/2259] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:18:39.610690 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc603ba-923a-4de1-b760-796e889d1f1e None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:39.611169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc603ba-923a-4de1-b760-796e889d1f1e None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:39.611321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc603ba-923a-4de1-b760-796e889d1f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:39.631148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2bc603ba-923a-4de1-b760-796e889d1f1e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:39.632351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2bc603ba-923a-4de1-b760-796e889d1f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:39.640088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1139/2260] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:18:39.662985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:39.673926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72876ba0-cbdd-460c-8773-d8cd8ce4f2ac service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:39.680060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:39.680659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:39.680969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:39.681243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:39.689311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:39.690920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:39.700296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1122/2261] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:18:43.816088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d8331-5072-4a07-a256-b5bc7f6c37c6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:43.816597 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d8331-5072-4a07-a256-b5bc7f6c37c6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:43.816715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d8331-5072-4a07-a256-b5bc7f6c37c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:43.836022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a32d8331-5072-4a07-a256-b5bc7f6c37c6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:18:43.837215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a32d8331-5072-4a07-a256-b5bc7f6c37c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:18:43.845066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1140/2262] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:18:43.872074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:18:43.883454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce895-25be-4b76-99aa-f6473bf57a53 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:18:43.888992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:18:43.889594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:18:43.889884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:18:43.890157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:18:43.898712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:18:43.900322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:18:43.909642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1123/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:18:53.830386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=32 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:18:53.905665 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:19:00.160136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb65e9-d3dd-4b9c-98bc-3f3f3acf2fe8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:00.160612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb65e9-d3dd-4b9c-98bc-3f3f3acf2fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:00.160711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb65e9-d3dd-4b9c-98bc-3f3f3acf2fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:00.180761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c1bb65e9-d3dd-4b9c-98bc-3f3f3acf2fe8 None None] MFA Rules not processed for user `c6f27a5bd8b14614a2652592ee0ac3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:00.181956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c1bb65e9-d3dd-4b9c-98bc-3f3f3acf2fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:00.236584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1141/2264] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:19:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:01.335814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:01.337425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:01.409151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3dd6-4344-4857-a015-fd1db7c6f174 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:01.415315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba3040-03c7-4b26-9b4a-13837cd43eed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:01.416015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3040-03c7-4b26-9b4a-13837cd43eed service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:01.416370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3040-03c7-4b26-9b4a-13837cd43eed service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:01.416717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3040-03c7-4b26-9b4a-13837cd43eed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:01.418721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ecba3040-03c7-4b26-9b4a-13837cd43eed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:01.432266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba3040-03c7-4b26-9b4a-13837cd43eed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:01.433855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba3040-03c7-4b26-9b4a-13837cd43eed service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:01.444843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1124/2265] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:02.530695 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906288-826f-4770-93cd-1ab368d59d08 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:02.531179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906288-826f-4770-93cd-1ab368d59d08 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:02.531292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906288-826f-4770-93cd-1ab368d59d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:02.550370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-26906288-826f-4770-93cd-1ab368d59d08 None None] MFA Rules not processed for user `64d2c283ac35442ebd3c46569d8062c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:02.551571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-26906288-826f-4770-93cd-1ab368d59d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:02.611463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1142/2266] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:19:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:11.440907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=32 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:19:12.615391 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=50 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:19:18.931917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced0a1b-5163-4c36-b4fa-6626ce730f6d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:18.932465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced0a1b-5163-4c36-b4fa-6626ce730f6d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:18.932465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced0a1b-5163-4c36-b4fa-6626ce730f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:18.952444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bced0a1b-5163-4c36-b4fa-6626ce730f6d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:18.953649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bced0a1b-5163-4c36-b4fa-6626ce730f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:18.961569 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1125/2267] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:19:18.982863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26906288-826f-4770-93cd-1ab368d59d08 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:18.996154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26906288-826f-4770-93cd-1ab368d59d08 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:19.001519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:19.002128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:19.002438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:19.002711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:19.011672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:19.013248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:19.022886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1143/2268] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:22.671317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9afa54-0e6a-4030-9b9b-b972a3867b0a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:22.671871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9afa54-0e6a-4030-9b9b-b972a3867b0a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:22.671992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9afa54-0e6a-4030-9b9b-b972a3867b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:22.695034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ce9afa54-0e6a-4030-9b9b-b972a3867b0a None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:22.696553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ce9afa54-0e6a-4030-9b9b-b972a3867b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:22.768320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1126/2269] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:19:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:19:22.819953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:22.821983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:22.902406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88207cf1-d45e-42f8-8a98-c7b736a9c75a service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:22.913628 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:22.915612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:22.915914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:22.916189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:22.927099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:22.929560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:22.940532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1144/2270] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:19:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:19:23.373230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d366c-f061-4c43-8eb0-f873caa4bb8d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:23.373492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d366c-f061-4c43-8eb0-f873caa4bb8d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:23.373725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d366c-f061-4c43-8eb0-f873caa4bb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:23.412324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-246d366c-f061-4c43-8eb0-f873caa4bb8d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:23.414460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-246d366c-f061-4c43-8eb0-f873caa4bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:23.428827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1127/2271] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:19:23.471825 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:23.485068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edf06e-c168-4905-a8fa-7dc14fa3fe3e service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:23.492489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:23.493469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:23.493949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:23.494760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:23.504416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:23.506304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:23.517436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1145/2272] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:27.475885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b8ed9-2429-437b-a9ac-867289c757d5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:27.476509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b8ed9-2429-437b-a9ac-867289c757d5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:27.476509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b8ed9-2429-437b-a9ac-867289c757d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:27.500931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-047b8ed9-2429-437b-a9ac-867289c757d5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:27.502158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-047b8ed9-2429-437b-a9ac-867289c757d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:27.511625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1128/2273] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:27.532247 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:27.544106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82b59-508d-4dc7-99e9-bcfed834dbed service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:27.549721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:27.550356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:27.550833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:27.551109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:27.560685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:27.562275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:27.573530 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1146/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:31.740262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5df8-9d6f-4b16-b4f6-fe38b32f11d1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:31.740818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5df8-9d6f-4b16-b4f6-fe38b32f11d1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:31.741154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5df8-9d6f-4b16-b4f6-fe38b32f11d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:31.778755 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-940d5df8-9d6f-4b16-b4f6-fe38b32f11d1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:31.780188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-940d5df8-9d6f-4b16-b4f6-fe38b32f11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:31.789976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1129/2275] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:31.812206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:31.830133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035c36-6d17-4653-9a9b-ff052b3b3d4a service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:31.839367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:31.840398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:31.840949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:31.841426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:31.857752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:31.860730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:31.889137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1147/2276] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:19:37.986767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed63af-6bcd-408b-8eae-6bc2d25c2858 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:37.987301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed63af-6bcd-408b-8eae-6bc2d25c2858 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:37.987301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed63af-6bcd-408b-8eae-6bc2d25c2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:38.006887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7fed63af-6bcd-408b-8eae-6bc2d25c2858 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:38.008584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7fed63af-6bcd-408b-8eae-6bc2d25c2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:38.016418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1130/2277] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Jul 28 22:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:38.043480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:38.054419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744c333-2a4c-41bd-9fc5-1dfeb827cd49 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:38.059881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eea395-96cb-452e-b722-f11398eb1695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:38.060485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eea395-96cb-452e-b722-f11398eb1695 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:38.060768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eea395-96cb-452e-b722-f11398eb1695 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:38.061048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eea395-96cb-452e-b722-f11398eb1695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:38.069147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eea395-96cb-452e-b722-f11398eb1695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:38.071617 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eea395-96cb-452e-b722-f11398eb1695 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:38.081238 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1148/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:42.752721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12513-9c0f-45a4-a349-a69735da1db6 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:42.753268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12513-9c0f-45a4-a349-a69735da1db6 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:42.753268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12513-9c0f-45a4-a349-a69735da1db6 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:42.754883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1131/2279] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:19:42.761253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea72a-e430-4087-b577-616f378639d4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:42.761726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea72a-e430-4087-b577-616f378639d4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:42.761823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea72a-e430-4087-b577-616f378639d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:42.769630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=63 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:19:42.782895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-67fea72a-e430-4087-b577-616f378639d4 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:42.784110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-67fea72a-e430-4087-b577-616f378639d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:42.793372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1149/2280] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:19:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:42.805356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12513-9c0f-45a4-a349-a69735da1db6 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:42.807091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-92d12513-9c0f-45a4-a349-a69735da1db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:42.812813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=41 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:19:42.869626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12513-9c0f-45a4-a349-a69735da1db6 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:42.873487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4e613-8cd1-461d-85ef-80d57d7d0ff5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:42.874214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e613-8cd1-461d-85ef-80d57d7d0ff5 service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:42.874712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e613-8cd1-461d-85ef-80d57d7d0ff5 service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:42.874988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e613-8cd1-461d-85ef-80d57d7d0ff5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:42.887670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4e613-8cd1-461d-85ef-80d57d7d0ff5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:42.889093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4e613-8cd1-461d-85ef-80d57d7d0ff5 service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:42.899703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1132/2281] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:42.973654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b336b8-e941-4874-8b71-f26bb3a4b835 None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:42.973857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b336b8-e941-4874-8b71-f26bb3a4b835 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:42.974119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b336b8-e941-4874-8b71-f26bb3a4b835 None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:42.975509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1150/2282] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 22:19:42.980144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee8b5c-8109-481c-8c69-fc10aea74de4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:42.980428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee8b5c-8109-481c-8c69-fc10aea74de4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:42.980839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee8b5c-8109-481c-8c69-fc10aea74de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:43.001138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-b9ee8b5c-8109-481c-8c69-fc10aea74de4 None None] MFA Rules not processed for user `ba7594ae41184fb09cd2399b7f35616e`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:43.002372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b9ee8b5c-8109-481c-8c69-fc10aea74de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:43.051335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1133/2283] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:19:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:43.064132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b336b8-e941-4874-8b71-f26bb3a4b835 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:43.065826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-99b336b8-e941-4874-8b71-f26bb3a4b835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:43.081586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b336b8-e941-4874-8b71-f26bb3a4b835 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:43.085333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091864a-cb47-4970-9e4c-ece321ddbdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:43.085946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091864a-cb47-4970-9e4c-ece321ddbdee service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:43.086218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091864a-cb47-4970-9e4c-ece321ddbdee service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:43.086513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091864a-cb47-4970-9e4c-ece321ddbdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:43.093654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091864a-cb47-4970-9e4c-ece321ddbdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:43.095124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091864a-cb47-4970-9e4c-ece321ddbdee service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:43.103364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1151/2284] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:43.185615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af614b-3d24-4cca-a578-a2378958b8fd None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:43.185976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af614b-3d24-4cca-a578-a2378958b8fd None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:43.186355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af614b-3d24-4cca-a578-a2378958b8fd None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:43.187939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1134/2285] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:19:43.193671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3c73-aa0b-418b-a146-958bf6f5cc10 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:43.193955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3c73-aa0b-418b-a146-958bf6f5cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:43.194245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3c73-aa0b-418b-a146-958bf6f5cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:43.213814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-951b3c73-aa0b-418b-a146-958bf6f5cc10 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:43.215067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-951b3c73-aa0b-418b-a146-958bf6f5cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:43.225101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1152/2286] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:19:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:43.236125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af614b-3d24-4cca-a578-a2378958b8fd None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:43.237865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-26af614b-3d24-4cca-a578-a2378958b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:43.252216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af614b-3d24-4cca-a578-a2378958b8fd None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:43.256778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:43.257400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:43.257680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:43.257953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:43.268782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:43.270216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:43.281490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1135/2287] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:19:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:19:46.499429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c982-df1d-4204-a1bc-977564616f67 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:46.499849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c982-df1d-4204-a1bc-977564616f67 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:46.499967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c982-df1d-4204-a1bc-977564616f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:46.519296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8a35c982-df1d-4204-a1bc-977564616f67 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:19:46.520497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8a35c982-df1d-4204-a1bc-977564616f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:19:46.528524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1153/2288] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:19:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:19:46.540741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:19:46.552714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260964-f90a-4c7a-969a-6610af492d1b service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:19:46.557331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:19:46.557951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:19:46.558258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:19:46.558534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:19:46.568138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:19:46.569726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:19:46.580719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1136/2289] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:19:56.513898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=14 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:19:56.575230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=60 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:15.019352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:20:15.019912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:20:15.019912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:20:15.039372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:20:15.041349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:20:15.048495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1154/2290] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 28 22:20:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:20:15.060854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:20:15.071240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c61f-ed00-4042-b1a7-e394e0437b9e service swift] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:20:15.076229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:20:15.076829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:20:15.077111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:20:15.077380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:20:15.085280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:20:15.086896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:20:15.095320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1137/2291] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:20:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:20:25.034884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:25.092098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=6 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:30.992726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:20:30.994190 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:20:31.009755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4a05-6111-4fb1-9064-1a4d36b01cd3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:20:31.014951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:20:31.015590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:20:31.015870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:20:31.016142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] PATH_INFO: `/v3/users/c6f27a5bd8b14614a2652592ee0ac3ef` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:20:31.017328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f27a5bd8b14614a2652592ee0ac3ef)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:20:31.019263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:20:31.067913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f27a5bd8b14614a2652592ee0ac3ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.068603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f27a5bd8b14614a2652592ee0ac3ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.076401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f27a5bd8b14614a2652592ee0ac3ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.083336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f27a5bd8b14614a2652592ee0ac3ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.094965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a39fc184-badb-4005-9464-e4e8d99bad94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f27a5bd8b14614a2652592ee0ac3ef'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.100826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1155/2292] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:20:30 2022] DELETE /identity/v3/users/c6f27a5bd8b14614a2652592ee0ac3ef => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:20:31.269636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:20:31.282515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419358c-5f69-49b5-a1e1-3469cb0215cb service swift] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:20:31.339771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:20:31.340426 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:20:31.340697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:20:31.340968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] PATH_INFO: `/v3/projects/1a92f4c6670e4668a37963245471871b` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:20:31.342124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a92f4c6670e4668a37963245471871b)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:20:31.344087 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:20:31.390765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a92f4c6670e4668a37963245471871b', 'request_id': 'req-15d4b6c7-a60a-43ac-855f-060b2cf45297'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.397370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a92f4c6670e4668a37963245471871b', 'request_id': 'req-15d4b6c7-a60a-43ac-855f-060b2cf45297'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.403095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a92f4c6670e4668a37963245471871b', 'request_id': 'req-15d4b6c7-a60a-43ac-855f-060b2cf45297'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.415052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] The token cache is being invalidate because project 1a92f4c6670e4668a37963245471871b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:20:31.415338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.415952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:20:31.417951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1138/2293] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:20:31 2022] DELETE /identity/v3/projects/1a92f4c6670e4668a37963245471871b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:20:40.314743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:20:40.315266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:20:40.315266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:20:40.334475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] MFA Rules not processed for user `aa550d74b152469e97d47b8ffdf7804a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:20:40.335672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:20:40.389361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1156/2294] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:20:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:20:41.412078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:50.382292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:20:57.566596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:20:57.568005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:20:57.624750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4b6c7-a60a-43ac-855f-060b2cf45297 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:20:57.628349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca5e6-8190-4d68-90ae-93883fb9cf6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:20:57.629236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca5e6-8190-4d68-90ae-93883fb9cf6b service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:20:57.629521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca5e6-8190-4d68-90ae-93883fb9cf6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:20:57.629796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca5e6-8190-4d68-90ae-93883fb9cf6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:20:57.631656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f84ca5e6-8190-4d68-90ae-93883fb9cf6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:20:57.700493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca5e6-8190-4d68-90ae-93883fb9cf6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:20:57.701924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca5e6-8190-4d68-90ae-93883fb9cf6b service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:20:57.712765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1139/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:20:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:00.344797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:00.346207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:00.402054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babaf1a-1113-4ed4-9eb7-cb488b0f567a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:00.405577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:00.406186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:00.406496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:00.406769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:00.408511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:00.422080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:00.423533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:00.434331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1157/2296] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:05.800453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:05.801005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:05.801113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:05.820592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] MFA Rules not processed for user `64d2c283ac35442ebd3c46569d8062c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:21:05.821786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:05.877246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1140/2297] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:21:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:21:06.190035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:06.198458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280548ce-39ec-4576-9616-73af1e217c3b service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:06.202002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:06.202729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:06.203010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:06.203329 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:06.205114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:06.215711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:06.217120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:06.224938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1158/2298] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:12.307471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:12.308880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:12.325157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd16d9d-75d1-4508-b6d8-a065abbf2d41 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:12.330587 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770dabc-8819-4168-a78a-8d9dc6ed6611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:12.331194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770dabc-8819-4168-a78a-8d9dc6ed6611 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:12.331475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770dabc-8819-4168-a78a-8d9dc6ed6611 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:12.331751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770dabc-8819-4168-a78a-8d9dc6ed6611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:12.333454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4770dabc-8819-4168-a78a-8d9dc6ed6611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:12.344703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770dabc-8819-4168-a78a-8d9dc6ed6611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:12.346341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770dabc-8819-4168-a78a-8d9dc6ed6611 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:12.355649 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1141/2299] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:16.221409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=32 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:21:22.351796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=85 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:21:23.187703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:23.200432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5717e-258b-431e-896d-0def950aa91f service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:23.205681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:23.206310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:23.206593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:23.206859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:23.208571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:23.266214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:23.267831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:23.276988 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1159/2300] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:30.377382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:30.377920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:30.377920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:30.397447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] MFA Rules not processed for user `c3b5516b045444cc959043157a4367ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:21:30.398681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:30.407022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1142/2301] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:21:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:21:30.741853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:30.751047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ababb-6721-4303-b05f-9e8d9d968243 service nova] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:30.754817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:30.755417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:30.755693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:30.755962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:30.757686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:30.767589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:30.768990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:30.777242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1160/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:31.082698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:31.084228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:31.161214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8787c43-0e70-4a27-be3d-7aba3bf67c1e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:31.166247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:31.166877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:31.167156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:31.167429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:31.169174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:31.180173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:31.182348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:31.191996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1143/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:33.011969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:33.022108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad1574-9f04-4b9c-ac10-d2fe58768c88 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:33.026511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:33.027138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:33.027415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:33.027686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:33.029495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:33.039844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:33.041333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:33.052817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1161/2304] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:21:33.705468 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:33.721935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28497c56-d518-4e58-956a-cfaef5773558 service placement] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:33.729013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:33.729635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:33.729916 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:33.730187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:33.732042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:33.745599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:33.747254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:33.758778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1144/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:21:43.048162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=40 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:21:43.754031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=41 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:21:51.724482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:21:51.734737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9060-9d8a-49aa-bd13-3f23f9214c3e service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:21:51.738514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:21:51.739145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:21:51.739427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:21:51.739697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:21:51.741449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:21:51.753081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:21:51.754773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:21:51.763554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1162/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:21:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:01.759835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=6 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:10.692938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:10.694423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:10.706423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee00ac-45ab-4fac-843e-ba65785f7f51 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:10.710036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:10.710677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:10.710961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:10.711237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:10.713051 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:10.774872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:10.776304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:10.785813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1145/2307] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:13.826698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:13.842055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dc2b5-58c3-475b-9900-5e312573ddad service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:13.847496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:13.848108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:13.848386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:13.848654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:13.850445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:13.863472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:13.865043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:13.876774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1163/2308] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:13.898671 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:13.900780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:13.913072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895d5c-999e-4c73-aa81-544ae5f90de8 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:13.922741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:13.923640 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:13.923990 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:13.924278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] PATH_INFO: `/v3/users/aa550d74b152469e97d47b8ffdf7804a` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:13.925504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa550d74b152469e97d47b8ffdf7804a)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:13.927512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:13.974983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa550d74b152469e97d47b8ffdf7804a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:13.975629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa550d74b152469e97d47b8ffdf7804a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:13.983081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa550d74b152469e97d47b8ffdf7804a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:13.983711 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa550d74b152469e97d47b8ffdf7804a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:13.995659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-80aa64da-6bbd-4f0f-8a0a-b2cc51d95a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa550d74b152469e97d47b8ffdf7804a'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:14.009101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1146/2309] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:13 2022] DELETE /identity/v3/users/aa550d74b152469e97d47b8ffdf7804a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:14.197906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.214509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36fe2-14c4-4f53-ab79-80d5fdd64b4d service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.272132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.272787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.273068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.273385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] PATH_INFO: `/v3/projects/2bc4aea4b4884176b9fe9bf6a5456ba2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.275267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc4aea4b4884176b9fe9bf6a5456ba2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.277274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.323810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc4aea4b4884176b9fe9bf6a5456ba2', 'request_id': 'req-d031a5b6-995d-4df4-b23e-02371d326eae'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:14.334017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc4aea4b4884176b9fe9bf6a5456ba2', 'request_id': 'req-d031a5b6-995d-4df4-b23e-02371d326eae'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:14.340780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc4aea4b4884176b9fe9bf6a5456ba2', 'request_id': 'req-d031a5b6-995d-4df4-b23e-02371d326eae'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:14.353376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] The token cache is being invalidate because project 2bc4aea4b4884176b9fe9bf6a5456ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:14.353663 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:14.354338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d031a5b6-995d-4df4-b23e-02371d326eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:14.356076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1164/2310] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:14 2022] DELETE /identity/v3/projects/2bc4aea4b4884176b9fe9bf6a5456ba2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:14.360814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c15ee-b02f-4cda-ad89-a2e33f7176f1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.361103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c15ee-b02f-4cda-ad89-a2e33f7176f1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.361400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c15ee-b02f-4cda-ad89-a2e33f7176f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.381969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-691c15ee-b02f-4cda-ad89-a2e33f7176f1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:14.383427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-691c15ee-b02f-4cda-ad89-a2e33f7176f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:14.447970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1147/2311] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:14.455697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a230-9808-47a6-9b8f-2d73444709d3 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.456055 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a230-9808-47a6-9b8f-2d73444709d3 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.456221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a230-9808-47a6-9b8f-2d73444709d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.476193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8b35a230-9808-47a6-9b8f-2d73444709d3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:14.477924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8b35a230-9808-47a6-9b8f-2d73444709d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:14.485691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1165/2312] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:14.489911 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c15ee-b02f-4cda-ad89-a2e33f7176f1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.499738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c15ee-b02f-4cda-ad89-a2e33f7176f1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.504544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.505144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.505419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.505687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.506399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:22:14.506698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.508278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.509744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:14.521696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1148/2313] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:22:14.526446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35a230-9808-47a6-9b8f-2d73444709d3 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.535586 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35a230-9808-47a6-9b8f-2d73444709d3 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.540897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.541500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.541775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.542045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.542808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.544691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.571445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1166/2314] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:14 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:14.575633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.585354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d69aa-c2df-4afd-ab44-368180fd1d8b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.639211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.639816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.640093 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.640361 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.641010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.642937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.664359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1149/2315] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:14 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:14.669012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.679183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f788d-eae0-495f-99b1-097ae81d6722 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.683757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.684356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.684633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.684903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.685587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.687207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.696972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1167/2316] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:14.700872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.710620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9a8d-ab61-4d58-8a06-8002fb627323 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.715768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eeb7d3-2d4c-4a8b-8140-c49d922e5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.716365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb7d3-2d4c-4a8b-8140-c49d922e5fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.716643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb7d3-2d4c-4a8b-8140-c49d922e5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.716913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb7d3-2d4c-4a8b-8140-c49d922e5fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.717600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eeb7d3-2d4c-4a8b-8140-c49d922e5fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.719220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eeb7d3-2d4c-4a8b-8140-c49d922e5fe2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.730001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1150/2317] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:14.733959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.743709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b1bc-f346-4387-945b-f73ea760a548 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.748302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.748942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.749219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.749490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] PATH_INFO: `/v3/projects/0b3d30f566104b38b1b4af66e6396e3b/users/1a2a0269d96e4c9aa7f213a558fc4d83/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.764048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3d30f566104b38b1b4af66e6396e3b, user_id=1a2a0269d96e4c9aa7f213a558fc4d83, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.766696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.779900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1168/2318] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:14 2022] PUT /identity/v3/projects/0b3d30f566104b38b1b4af66e6396e3b/users/1a2a0269d96e4c9aa7f213a558fc4d83/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:14.790425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc9e8-087c-42e1-b5f2-628a7c535c38 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.790743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc9e8-087c-42e1-b5f2-628a7c535c38 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.791016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc9e8-087c-42e1-b5f2-628a7c535c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.817553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-7dbbc9e8-087c-42e1-b5f2-628a7c535c38 None None] MFA Rules not processed for user `1a2a0269d96e4c9aa7f213a558fc4d83`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:14.818804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7dbbc9e8-087c-42e1-b5f2-628a7c535c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:14.881113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1151/2319] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:14.892623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:14.894415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:14.909387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:14.969179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a3f1-521e-4b99-839c-b51fe942c9d3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:14.974692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574c968-4491-4051-9076-e1adecf56a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:14.975302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c968-4491-4051-9076-e1adecf56a76 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:14.975575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c968-4491-4051-9076-e1adecf56a76 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:14.975838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c968-4491-4051-9076-e1adecf56a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:14.983628 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574c968-4491-4051-9076-e1adecf56a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:14.985197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574c968-4491-4051-9076-e1adecf56a76 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:14.993764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1169/2320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:17.659151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc9e8-087c-42e1-b5f2-628a7c535c38 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:17.722115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc9e8-087c-42e1-b5f2-628a7c535c38 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:17.726802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:17.727467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:17.727742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:17.728013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] PATH_INFO: `/v3/users/1a2a0269d96e4c9aa7f213a558fc4d83` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:17.729168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2a0269d96e4c9aa7f213a558fc4d83)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:17.731112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:17.733453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:17.781346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2a0269d96e4c9aa7f213a558fc4d83'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:17.782008 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2a0269d96e4c9aa7f213a558fc4d83'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:17.788712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2a0269d96e4c9aa7f213a558fc4d83'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:17.789336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2a0269d96e4c9aa7f213a558fc4d83'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:17.801367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2a0269d96e4c9aa7f213a558fc4d83'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:17.813623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1152/2321] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:17 2022] DELETE /identity/v3/users/1a2a0269d96e4c9aa7f213a558fc4d83 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:22:17.818104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:17.818614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:17.818719 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:17.837198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:17.838417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:17.896470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1170/2322] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:17.906078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:17.907517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:17.964447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4baa3-2b26-4935-b8e3-c87ba2491cad admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:17.968113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e7fcb-3f0d-4cc8-a71f-7e7ae217b8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:17.968726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7fcb-3f0d-4cc8-a71f-7e7ae217b8be service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:17.969003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7fcb-3f0d-4cc8-a71f-7e7ae217b8be service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:17.969273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e7fcb-3f0d-4cc8-a71f-7e7ae217b8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:17.978773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e7fcb-3f0d-4cc8-a71f-7e7ae217b8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:17.980193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e7fcb-3f0d-4cc8-a71f-7e7ae217b8be service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:17.989475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1153/2323] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:18.248960 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.250494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:18.262611 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35605c-ab0e-4e8d-86ff-3d9fe253f6bf None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.267102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.267742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.268014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.268277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] PATH_INFO: `/v3/projects/0b3d30f566104b38b1b4af66e6396e3b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.269415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3d30f566104b38b1b4af66e6396e3b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.271345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.318068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3d30f566104b38b1b4af66e6396e3b', 'request_id': 'req-514fac85-985f-47fa-8a18-392833a61892'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:18.325153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3d30f566104b38b1b4af66e6396e3b', 'request_id': 'req-514fac85-985f-47fa-8a18-392833a61892'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:18.331418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3d30f566104b38b1b4af66e6396e3b', 'request_id': 'req-514fac85-985f-47fa-8a18-392833a61892'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:18.343051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] The token cache is being invalidate because project 0b3d30f566104b38b1b4af66e6396e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:18.343337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:18.343975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-514fac85-985f-47fa-8a18-392833a61892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:18.345465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1171/2324] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:18 2022] DELETE /identity/v3/projects/0b3d30f566104b38b1b4af66e6396e3b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:18.350311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fe48-b34f-44c0-96cb-f93dd06ae8e3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.350598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fe48-b34f-44c0-96cb-f93dd06ae8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.350871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fe48-b34f-44c0-96cb-f93dd06ae8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.370862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c816fe48-b34f-44c0-96cb-f93dd06ae8e3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:18.372071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c816fe48-b34f-44c0-96cb-f93dd06ae8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:18.430324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1154/2325] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:18.437869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79c7b-8d9d-4dde-a7da-84f8c1925f14 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.438157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79c7b-8d9d-4dde-a7da-84f8c1925f14 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.438474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79c7b-8d9d-4dde-a7da-84f8c1925f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.457641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b6c79c7b-8d9d-4dde-a7da-84f8c1925f14 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:18.458876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b6c79c7b-8d9d-4dde-a7da-84f8c1925f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:18.467315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1172/2326] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:18.471350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816fe48-b34f-44c0-96cb-f93dd06ae8e3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.481598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816fe48-b34f-44c0-96cb-f93dd06ae8e3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.486246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.486862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.487142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.487415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.488097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:22:18.488402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.489991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.501818 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1155/2327] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:22:18.506252 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c79c7b-8d9d-4dde-a7da-84f8c1925f14 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.515378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c79c7b-8d9d-4dde-a7da-84f8c1925f14 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.520166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.520780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.521062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.521333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.522034 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.523957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.539011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:18.552718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1173/2328] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:18 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:18.556970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.566961 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384bee-156a-4239-897d-e857b649283e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.575080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:18.624384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.625006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.625287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.625562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.626259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.628477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.650522 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1156/2329] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:18 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:22:18.654644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.664910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a915d-2ef1-41d5-b025-c6b6f53567ba admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.669680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.670321 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.670601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.670872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.671555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.673126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.682944 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1174/2330] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:18.686725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.697063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf0ae7-5d25-4a50-901f-17bde62b06fb admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.701698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768de42-48a1-4e41-ba7b-d464ee524880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.702337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768de42-48a1-4e41-ba7b-d464ee524880 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.702618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768de42-48a1-4e41-ba7b-d464ee524880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.702891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768de42-48a1-4e41-ba7b-d464ee524880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.703579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768de42-48a1-4e41-ba7b-d464ee524880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.705162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768de42-48a1-4e41-ba7b-d464ee524880 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.716091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1157/2331] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:18.719915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.729465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677b406-0da6-488d-8458-3e5b895487d0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.734059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.734740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.735018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.735287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] PATH_INFO: `/v3/projects/1a2aa4562225495fbeadf1386f13acc3/users/21e44e64bfb34736999f8fe1369b1f35/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.749491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2aa4562225495fbeadf1386f13acc3, user_id=21e44e64bfb34736999f8fe1369b1f35, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.752141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.765481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1175/2332] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:18 2022] PUT /identity/v3/projects/1a2aa4562225495fbeadf1386f13acc3/users/21e44e64bfb34736999f8fe1369b1f35/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:18.770553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ea8c7-9033-4f62-b8c5-7a0ef338c5c0 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.770844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ea8c7-9033-4f62-b8c5-7a0ef338c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.771146 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ea8c7-9033-4f62-b8c5-7a0ef338c5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.790022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-a03ea8c7-9033-4f62-b8c5-7a0ef338c5c0 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:18.791261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a03ea8c7-9033-4f62-b8c5-7a0ef338c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:18.848753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1158/2333] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:18.858379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:18.860063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:18.916795 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97584ab8-215c-46d2-9526-ebbdee93566c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:18.920457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:18.921064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:18.921342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:18.921613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:18.930997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:18.932409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:18.941816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1176/2334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:19.553883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685a45d-ca43-4f87-bbcf-7e8b9cd3fcb4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:19.554170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685a45d-ca43-4f87-bbcf-7e8b9cd3fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:19.554528 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685a45d-ca43-4f87-bbcf-7e8b9cd3fcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:19.582784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-6685a45d-ca43-4f87-bbcf-7e8b9cd3fcb4 None None] MFA Rules not processed for user `21e44e64bfb34736999f8fe1369b1f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:19.584009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6685a45d-ca43-4f87-bbcf-7e8b9cd3fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:19.650190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1159/2335] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:19.654716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:19.664375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e09da-78ec-4b12-947b-831fcb924734 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:19.669515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:19.670199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:19.670544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:19.670797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:19.671740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:19.673651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:19.701160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1177/2336] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:19 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:19.705302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685a45d-ca43-4f87-bbcf-7e8b9cd3fcb4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:19.716954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685a45d-ca43-4f87-bbcf-7e8b9cd3fcb4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:19.733920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:19.773460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:19.774078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:19.774888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:19.775163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:19.775822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:19.777745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:19.798737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1160/2337] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:19 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:19.802757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:19.812860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6afa-f3a0-4ad9-8138-ac5d8c54d508 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:19.817442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:19.818036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:19.818350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:19.818618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:19.819295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:19.820862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:19.831189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1178/2338] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:19.835167 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:19.845601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c0ef2-f305-4fdd-ad7c-393cb735ae9f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:19.850200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:19.850887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:19.851169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:19.851446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] PATH_INFO: `/v3/projects/37524a33834d4e539c04edb352df081f/users/ad5654e643794667a8eb884b8b1701aa/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:19.866800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=37524a33834d4e539c04edb352df081f, user_id=ad5654e643794667a8eb884b8b1701aa, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:19.869538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:19.881933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1161/2339] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:19 2022] PUT /identity/v3/projects/37524a33834d4e539c04edb352df081f/users/ad5654e643794667a8eb884b8b1701aa/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:19.885938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:19.896100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46639aef-bade-4e39-afb5-bb61064564fb admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:19.950729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889299d9-962e-4fe7-8733-e4555ddc95f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:19.951341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889299d9-962e-4fe7-8733-e4555ddc95f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:19.951687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889299d9-962e-4fe7-8733-e4555ddc95f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:19.951902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889299d9-962e-4fe7-8733-e4555ddc95f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:19.952593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889299d9-962e-4fe7-8733-e4555ddc95f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:19.954289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889299d9-962e-4fe7-8733-e4555ddc95f6 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:19.964363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1179/2340] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:19.968479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:19.979295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee085073-2daa-43a0-9aee-720b67fcd0ef admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:19.983864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f1ded-356f-414e-9749-41a07e2de02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:19.984567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f1ded-356f-414e-9749-41a07e2de02f admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:19.984793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f1ded-356f-414e-9749-41a07e2de02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:19.985065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f1ded-356f-414e-9749-41a07e2de02f admin admin] PATH_INFO: `/v3/projects/37524a33834d4e539c04edb352df081f/users/ad5654e643794667a8eb884b8b1701aa/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:19.987013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f1ded-356f-414e-9749-41a07e2de02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37524a33834d4e539c04edb352df081f, user_id=ad5654e643794667a8eb884b8b1701aa, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:19.989642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f1ded-356f-414e-9749-41a07e2de02f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:19.999723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1162/2341] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:19 2022] PUT /identity/v3/projects/37524a33834d4e539c04edb352df081f/users/ad5654e643794667a8eb884b8b1701aa/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:20.604118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a94ec-bb39-44d3-9a4b-9d3f7bab0d99 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:20.604508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a94ec-bb39-44d3-9a4b-9d3f7bab0d99 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:20.604849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a94ec-bb39-44d3-9a4b-9d3f7bab0d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:20.632580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b77a94ec-bb39-44d3-9a4b-9d3f7bab0d99 None None] MFA Rules not processed for user `ad5654e643794667a8eb884b8b1701aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:20.633829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b77a94ec-bb39-44d3-9a4b-9d3f7bab0d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:20.645481 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:20.710154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1180/2342] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:21.226461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41157177-7e8e-46b9-99ee-f23f30cb7a26 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:21.227026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41157177-7e8e-46b9-99ee-f23f30cb7a26 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:21.227026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41157177-7e8e-46b9-99ee-f23f30cb7a26 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:21.228542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1163/2343] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:22:21.253263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0567c9d-0ba2-4831-ab4a-0433104704d2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:21.253740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0567c9d-0ba2-4831-ab4a-0433104704d2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:21.253838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0567c9d-0ba2-4831-ab4a-0433104704d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:21.275516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f0567c9d-0ba2-4831-ab4a-0433104704d2 None None] MFA Rules not processed for user `3cd150c9bbd648feb1a2688397c3bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:21.276834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0567c9d-0ba2-4831-ab4a-0433104704d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:21.347027 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1181/2344] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:22:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:21.359233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41157177-7e8e-46b9-99ee-f23f30cb7a26 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:21.361443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-41157177-7e8e-46b9-99ee-f23f30cb7a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:21.381057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41157177-7e8e-46b9-99ee-f23f30cb7a26 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:21.387633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:21.388358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:21.388708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:21.389045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:21.398601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:21.400791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:21.412006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1164/2345] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:22:21.797338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0567c9d-0ba2-4831-ab4a-0433104704d2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:21.863640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0567c9d-0ba2-4831-ab4a-0433104704d2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:21.868198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:21.868834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:21.869109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:21.869379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] PATH_INFO: `/v3/users/21e44e64bfb34736999f8fe1369b1f35` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:21.870580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e44e64bfb34736999f8fe1369b1f35)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:21.872495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:21.917054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e44e64bfb34736999f8fe1369b1f35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:21.917652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e44e64bfb34736999f8fe1369b1f35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:21.919387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:21.926559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e44e64bfb34736999f8fe1369b1f35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:21.934128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e44e64bfb34736999f8fe1369b1f35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:21.945987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e44e64bfb34736999f8fe1369b1f35'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:21.952496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1182/2346] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:21 2022] DELETE /identity/v3/users/21e44e64bfb34736999f8fe1369b1f35 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:22.122121 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:22.132922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9353b-38fc-4761-8e58-87cc0de53fa9 service placement] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:22.203753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:22.204319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:22.204599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:22.204876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] PATH_INFO: `/v3/projects/1a2aa4562225495fbeadf1386f13acc3` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:22.206021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2aa4562225495fbeadf1386f13acc3)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:22.207955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:22.252360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2aa4562225495fbeadf1386f13acc3', 'request_id': 'req-56ba8866-f699-44e7-8a0f-67baca9a0698'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.258488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2aa4562225495fbeadf1386f13acc3', 'request_id': 'req-56ba8866-f699-44e7-8a0f-67baca9a0698'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.263537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:22.264700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2aa4562225495fbeadf1386f13acc3', 'request_id': 'req-56ba8866-f699-44e7-8a0f-67baca9a0698'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.278568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] The token cache is being invalidate because project 1a2aa4562225495fbeadf1386f13acc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:22.278877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.279495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.280978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1165/2347] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:22 2022] DELETE /identity/v3/projects/1a2aa4562225495fbeadf1386f13acc3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:22.284972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:22.286548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:22.300168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc964cdf-fa7a-4f47-b5d2-8def5391ff0a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:22.355800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:22.356440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:22.356718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:22.356987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] PATH_INFO: `/v3/users/ad5654e643794667a8eb884b8b1701aa` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:22.358126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5654e643794667a8eb884b8b1701aa)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:22.360081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:22.404366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5654e643794667a8eb884b8b1701aa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.405018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5654e643794667a8eb884b8b1701aa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.412438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5654e643794667a8eb884b8b1701aa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.419637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5654e643794667a8eb884b8b1701aa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.431645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-23bc8e0a-67e0-40dd-ae82-0e1dd5820476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5654e643794667a8eb884b8b1701aa'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.437801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1183/2348] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:22 2022] DELETE /identity/v3/users/ad5654e643794667a8eb884b8b1701aa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:22:22.605071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:22.606631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:22.620271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba8866-f699-44e7-8a0f-67baca9a0698 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:22.677935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:22.678616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:22.678908 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:22.679351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] PATH_INFO: `/v3/projects/37524a33834d4e539c04edb352df081f` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:22.680547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37524a33834d4e539c04edb352df081f)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:22.682720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:22.729621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37524a33834d4e539c04edb352df081f', 'request_id': 'req-c7e7f07d-f3b9-4876-b772-0d069ed5006c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.735632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37524a33834d4e539c04edb352df081f', 'request_id': 'req-c7e7f07d-f3b9-4876-b772-0d069ed5006c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.741001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37524a33834d4e539c04edb352df081f', 'request_id': 'req-c7e7f07d-f3b9-4876-b772-0d069ed5006c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.754311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] The token cache is being invalidate because project 37524a33834d4e539c04edb352df081f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:22.754543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.755182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c7e7f07d-f3b9-4876-b772-0d069ed5006c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:22.757084 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1166/2349] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:22 2022] DELETE /identity/v3/projects/37524a33834d4e539c04edb352df081f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:22.761924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23151-a621-4bca-969a-9f6aebc6e41b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:22.762216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23151-a621-4bca-969a-9f6aebc6e41b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:22.762528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23151-a621-4bca-969a-9f6aebc6e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:22.782083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b8c23151-a621-4bca-969a-9f6aebc6e41b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:22.783314 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b8c23151-a621-4bca-969a-9f6aebc6e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:22.822576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:22.842589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1184/2350] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:22.850145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f3bf0-cd9f-4461-b30e-584fdb30fcd3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:22.850489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f3bf0-cd9f-4461-b30e-584fdb30fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:22.850763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f3bf0-cd9f-4461-b30e-584fdb30fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:22.870502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-1a7f3bf0-cd9f-4461-b30e-584fdb30fcd3 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:22.871691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1a7f3bf0-cd9f-4461-b30e-584fdb30fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:22.880003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1167/2351] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:22.884130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23151-a621-4bca-969a-9f6aebc6e41b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:22.894215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23151-a621-4bca-969a-9f6aebc6e41b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:22.898797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:22.899929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:22.900208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:22.900477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:22.901156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:22:22.901456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:22.903062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:22.914335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1185/2352] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:22:22.919070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f3bf0-cd9f-4461-b30e-584fdb30fcd3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:22.928210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f3bf0-cd9f-4461-b30e-584fdb30fcd3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:22.933118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:22.933757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:22.934031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:22.934334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:22.934986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:22.936922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:22.963674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1168/2353] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:22 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:22.967624 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:22.977440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca25c-9eaf-4260-ac50-aad6b5b15b88 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.032740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.033284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.033680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.033856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.034788 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.036709 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.058385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1186/2354] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:22 2022] POST /identity/v3/users => generated 278 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:22:23.062809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.074040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856b45-fd4c-4a07-a778-121032e2a47c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.078738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.079337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.079612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.079882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.080564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.082145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.092253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1169/2355] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:23.096024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.105994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f74d2e-839a-411c-b29b-e4beb35e36ab admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.110647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3476d74-5f3d-4954-9334-731007bf4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.111251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476d74-5f3d-4954-9334-731007bf4365 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.111528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476d74-5f3d-4954-9334-731007bf4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.111799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476d74-5f3d-4954-9334-731007bf4365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.112488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3476d74-5f3d-4954-9334-731007bf4365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.114064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3476d74-5f3d-4954-9334-731007bf4365 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.124598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1187/2356] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:23.128860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.139369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64d8a-49a4-489a-9a77-7fc1a01c91a3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.143948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.144601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.144877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.145144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] PATH_INFO: `/v3/projects/7e76ca5d2d0e4401a6fc1a22adb6978f/users/b2f44a3d06464840bc37d4ff40a77e1f/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.160502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e76ca5d2d0e4401a6fc1a22adb6978f, user_id=b2f44a3d06464840bc37d4ff40a77e1f, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.163173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.175590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1170/2357] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:23 2022] PUT /identity/v3/projects/7e76ca5d2d0e4401a6fc1a22adb6978f/users/b2f44a3d06464840bc37d4ff40a77e1f/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:23.185887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb2f9-fa73-4985-8df3-6a9bab13d098 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.186175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb2f9-fa73-4985-8df3-6a9bab13d098 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.186487 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb2f9-fa73-4985-8df3-6a9bab13d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.214458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-94afb2f9-fa73-4985-8df3-6a9bab13d098 None None] MFA Rules not processed for user `b2f44a3d06464840bc37d4ff40a77e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:23.215664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-94afb2f9-fa73-4985-8df3-6a9bab13d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:23.282485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1188/2358] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:23 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:23.287198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.304757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:23.351751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aba49-feca-4206-bda2-8f1c3ec8af70 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.356475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.357096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.357377 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.357655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.358355 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.360267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.390353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1171/2359] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:23 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:23.399237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afb2f9-fa73-4985-8df3-6a9bab13d098 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.414313 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afb2f9-fa73-4985-8df3-6a9bab13d098 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.453263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:23.473318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.473939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.474225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.474529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.475188 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.477101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.503930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1189/2360] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:23 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:23.506707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.517454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94572377-1f44-48d7-aecd-95d6172342c8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.522003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.522647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.522948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.523221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.523903 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.525551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.535936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1172/2361] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:23.540116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.549923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a333-3945-4af9-85f9-20c606c1b686 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.554784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.555464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.556255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.556529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] PATH_INFO: `/v3/projects/7c9a9deea2bc44548fc7640927effad8/users/d244786fc11446c1916c32ec4473ccb8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.571331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9a9deea2bc44548fc7640927effad8, user_id=d244786fc11446c1916c32ec4473ccb8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.574514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.587089 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1190/2362] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:23 2022] PUT /identity/v3/projects/7c9a9deea2bc44548fc7640927effad8/users/d244786fc11446c1916c32ec4473ccb8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:23.591047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.600925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a6446-c643-43c1-aafa-ddf638953995 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.655538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37616-eb8d-4534-a5fe-66d0beaf62c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.656165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37616-eb8d-4534-a5fe-66d0beaf62c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.656436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37616-eb8d-4534-a5fe-66d0beaf62c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.656829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37616-eb8d-4534-a5fe-66d0beaf62c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.657578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37616-eb8d-4534-a5fe-66d0beaf62c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.659279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37616-eb8d-4534-a5fe-66d0beaf62c7 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.669000 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1173/2363] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:23.673178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.683896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584b606-8a94-47f4-87dc-c30c05b86f47 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.688651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.689332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.689612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.689882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] PATH_INFO: `/v3/projects/7c9a9deea2bc44548fc7640927effad8/users/d244786fc11446c1916c32ec4473ccb8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.691903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9a9deea2bc44548fc7640927effad8, user_id=d244786fc11446c1916c32ec4473ccb8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.694541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.705140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1191/2364] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:23 2022] PUT /identity/v3/projects/7c9a9deea2bc44548fc7640927effad8/users/d244786fc11446c1916c32ec4473ccb8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:23.716553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e600-719a-4e08-85ab-b9c4f3a85f55 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.716830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e600-719a-4e08-85ab-b9c4f3a85f55 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.717109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e600-719a-4e08-85ab-b9c4f3a85f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.746077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ac01e600-719a-4e08-85ab-b9c4f3a85f55 None None] MFA Rules not processed for user `d244786fc11446c1916c32ec4473ccb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:23.747310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ac01e600-719a-4e08-85ab-b9c4f3a85f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:23.814703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1174/2365] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:23 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:23.825882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.827662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:23.885451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222448-d8b8-4c61-9f08-852dbbf65d83 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.889029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.889632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.889932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.890186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:23.899079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:23.900490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:23.909731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1192/2366] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:23 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:23.983075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e600-719a-4e08-85ab-b9c4f3a85f55 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:23.992625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e600-719a-4e08-85ab-b9c4f3a85f55 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:23.996865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137e53e-ca1d-42ab-8ba0-c8c1b1977e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:23.997471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e53e-ca1d-42ab-8ba0-c8c1b1977e36 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:23.997747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e53e-ca1d-42ab-8ba0-c8c1b1977e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:23.998014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e53e-ca1d-42ab-8ba0-c8c1b1977e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:24.007483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:24.054642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137e53e-ca1d-42ab-8ba0-c8c1b1977e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:24.056634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137e53e-ca1d-42ab-8ba0-c8c1b1977e36 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:24.065633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1175/2367] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:23 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:33.905588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:34.061581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=23 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:38.980789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:39.040968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b627a-40ce-4bea-aad2-eb76e9fc1e21 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:39.045931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:39.046592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:39.046871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:39.047162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] PATH_INFO: `/v3/users/b2f44a3d06464840bc37d4ff40a77e1f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:39.048318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f44a3d06464840bc37d4ff40a77e1f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:39.050219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:39.100222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f44a3d06464840bc37d4ff40a77e1f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.100959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f44a3d06464840bc37d4ff40a77e1f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.109073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f44a3d06464840bc37d4ff40a77e1f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.115955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f44a3d06464840bc37d4ff40a77e1f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.127345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f44a3d06464840bc37d4ff40a77e1f'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.133369 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1193/2368] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:38 2022] DELETE /identity/v3/users/b2f44a3d06464840bc37d4ff40a77e1f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:39.138024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:39.138543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:39.138776 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:39.158642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:39.160290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:39.218498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1176/2369] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:22:39.228050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:39.230037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:39.287315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc1013-36c5-4f13-8e30-2b32a142c034 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:39.291275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:39.292430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:39.292730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:39.292993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:39.302495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:39.303921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:39.313340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1194/2370] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:39.585039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:39.586502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:39.599372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92591896-5ea3-409a-9da5-eaad76f22ce8 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:39.604080 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:39.604725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:39.605004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:39.605280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] PATH_INFO: `/v3/projects/7e76ca5d2d0e4401a6fc1a22adb6978f` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:39.606476 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e76ca5d2d0e4401a6fc1a22adb6978f)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:39.608400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:39.657561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e76ca5d2d0e4401a6fc1a22adb6978f', 'request_id': 'req-70606746-ac2e-4339-9ee1-6ad830ffe3b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.663548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e76ca5d2d0e4401a6fc1a22adb6978f', 'request_id': 'req-70606746-ac2e-4339-9ee1-6ad830ffe3b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.669040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e76ca5d2d0e4401a6fc1a22adb6978f', 'request_id': 'req-70606746-ac2e-4339-9ee1-6ad830ffe3b5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.680897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] The token cache is being invalidate because project 7e76ca5d2d0e4401a6fc1a22adb6978f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:39.681184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.681807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.683356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1177/2371] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:39 2022] DELETE /identity/v3/projects/7e76ca5d2d0e4401a6fc1a22adb6978f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:39.687300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:39.696669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c865-ac20-4a12-bbfb-86306729b1d0 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:39.715346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:39.756591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:39.757223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:39.757515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:39.757769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] PATH_INFO: `/v3/users/d244786fc11446c1916c32ec4473ccb8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:39.758951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d244786fc11446c1916c32ec4473ccb8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:39.761577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:39.804913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd244786fc11446c1916c32ec4473ccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.805545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd244786fc11446c1916c32ec4473ccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.812994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd244786fc11446c1916c32ec4473ccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.820006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd244786fc11446c1916c32ec4473ccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.832026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-edc5778c-0405-4f67-89d4-d9d7df882f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd244786fc11446c1916c32ec4473ccb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:39.837729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1195/2372] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:39 2022] DELETE /identity/v3/users/d244786fc11446c1916c32ec4473ccb8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:40.100620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.102161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:40.115992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70606746-ac2e-4339-9ee1-6ad830ffe3b5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.174550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.175212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.175463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.175737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] PATH_INFO: `/v3/projects/7c9a9deea2bc44548fc7640927effad8` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.176918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9a9deea2bc44548fc7640927effad8)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.178890 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.211221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:40.228063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9a9deea2bc44548fc7640927effad8', 'request_id': 'req-e216e746-3088-4990-a7c6-a6a07d95fad6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:40.234506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9a9deea2bc44548fc7640927effad8', 'request_id': 'req-e216e746-3088-4990-a7c6-a6a07d95fad6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:40.239891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9a9deea2bc44548fc7640927effad8', 'request_id': 'req-e216e746-3088-4990-a7c6-a6a07d95fad6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:40.252138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] The token cache is being invalidate because project 7c9a9deea2bc44548fc7640927effad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:40.252448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:40.253323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e216e746-3088-4990-a7c6-a6a07d95fad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:40.254875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1178/2373] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:40 2022] DELETE /identity/v3/projects/7c9a9deea2bc44548fc7640927effad8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:40.259861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220d852-8eb0-49ab-813b-468db7d33d38 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.260363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220d852-8eb0-49ab-813b-468db7d33d38 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.260465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220d852-8eb0-49ab-813b-468db7d33d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.279780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5220d852-8eb0-49ab-813b-468db7d33d38 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:40.280975 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5220d852-8eb0-49ab-813b-468db7d33d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:40.337450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1196/2374] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:40.345264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39779-415d-4ac3-949b-5d83786f412a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.345485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39779-415d-4ac3-949b-5d83786f412a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.345763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39779-415d-4ac3-949b-5d83786f412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.365581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-f6e39779-415d-4ac3-949b-5d83786f412a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:40.366809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f6e39779-415d-4ac3-949b-5d83786f412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:40.375323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1179/2375] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:40.379826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220d852-8eb0-49ab-813b-468db7d33d38 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.389336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220d852-8eb0-49ab-813b-468db7d33d38 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.393914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.394556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.394834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.395102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.395787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:22:40.396099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.397668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.409464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1197/2376] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:22:40.413582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39779-415d-4ac3-949b-5d83786f412a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.423491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39779-415d-4ac3-949b-5d83786f412a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.428187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.428790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.429072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.429344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.429998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.432697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.459006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1180/2377] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:40 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:40.463045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.472720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb11ff-ec40-4962-a1f8-756c66fa249d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.498985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:40.530042 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.530675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.530953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.531223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.531866 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.533764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.555432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1198/2378] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:40 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:40.559899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.569992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478391fc-987f-4fea-98f4-021f86a7bf01 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.574716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.575320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.575600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.575875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.576565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.578190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.588006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1181/2379] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:40.592357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.602730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf743e-d40d-45af-be2f-257776e80767 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.607970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb09f5f-0f8b-447d-a18f-fd0387980d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.608572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09f5f-0f8b-447d-a18f-fd0387980d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.608854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09f5f-0f8b-447d-a18f-fd0387980d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.609128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09f5f-0f8b-447d-a18f-fd0387980d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.609816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb09f5f-0f8b-447d-a18f-fd0387980d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.611447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb09f5f-0f8b-447d-a18f-fd0387980d1f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.621768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1199/2380] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:40.625806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.635901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df0dc1-f573-4f39-975d-3a9a508770bb admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.640535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.641181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.641463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.641737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] PATH_INFO: `/v3/projects/b84923a2141849788cb623fdaa37b544/users/0e536f58dade4f0ab5d2910526d0884b/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.656743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84923a2141849788cb623fdaa37b544, user_id=0e536f58dade4f0ab5d2910526d0884b, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.659537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.672897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1182/2381] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:40 2022] PUT /identity/v3/projects/b84923a2141849788cb623fdaa37b544/users/0e536f58dade4f0ab5d2910526d0884b/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:40.684220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1dc10-816b-4f77-80b9-664d24a80f3f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.684510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1dc10-816b-4f77-80b9-664d24a80f3f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.684789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1dc10-816b-4f77-80b9-664d24a80f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.711954 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f0f1dc10-816b-4f77-80b9-664d24a80f3f None None] MFA Rules not processed for user `0e536f58dade4f0ab5d2910526d0884b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:40.713738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0f1dc10-816b-4f77-80b9-664d24a80f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:40.777117 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1200/2382] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:40.781564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.841484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b7641-8b9f-49eb-bbbc-f60e56b19ac8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.846069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.846704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.846982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.847251 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.847897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.849777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.876351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1183/2383] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:40 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:22:40.880560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1dc10-816b-4f77-80b9-664d24a80f3f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.891525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1dc10-816b-4f77-80b9-664d24a80f3f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.946414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.947028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.947305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.947575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.948231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.950161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:40.970653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1201/2384] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:40 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:40.974658 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:40.985414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af6482-02db-47c0-bfa9-98d829bec8cb admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:40.989935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:40.990571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:40.990850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:40.991120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:40.991800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:40.993418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.003856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1184/2385] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:41.007683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.018018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9b0d6-db41-44b2-9bfe-f4f7a401314f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.022649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487217f-f5f3-4e43-bd59-bbb8d4ee4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.023245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487217f-f5f3-4e43-bd59-bbb8d4ee4b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.023525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487217f-f5f3-4e43-bd59-bbb8d4ee4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.023798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487217f-f5f3-4e43-bd59-bbb8d4ee4b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.024485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487217f-f5f3-4e43-bd59-bbb8d4ee4b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.026700 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487217f-f5f3-4e43-bd59-bbb8d4ee4b3b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.036504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1202/2386] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:41.040288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.049902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304bf80-70f3-4064-8924-148e1e98fc68 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.054453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.055088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.055362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.055628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] PATH_INFO: `/v3/projects/83fdaab74a5743f9bdb8077d17905481/users/6e3ab7bdd6eb4207ae17b7858e553389/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.070577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fdaab74a5743f9bdb8077d17905481, user_id=6e3ab7bdd6eb4207ae17b7858e553389, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.074713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.085491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:41.092074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1185/2387] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:41 2022] PUT /identity/v3/projects/83fdaab74a5743f9bdb8077d17905481/users/6e3ab7bdd6eb4207ae17b7858e553389/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:41.102453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d70e0-644f-421e-9ba6-941d979f0222 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.102741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d70e0-644f-421e-9ba6-941d979f0222 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.103017 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d70e0-644f-421e-9ba6-941d979f0222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.130365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-027d70e0-644f-421e-9ba6-941d979f0222 None None] MFA Rules not processed for user `6e3ab7bdd6eb4207ae17b7858e553389`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:41.131495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-027d70e0-644f-421e-9ba6-941d979f0222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:41.136015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:41.196427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1203/2388] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:41.201442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.262053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a037f8-1eef-4341-998c-adb7290da978 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.266679 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.267281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.267559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.267826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.268498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.270410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.297553 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1186/2389] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:41 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:41.301756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d70e0-644f-421e-9ba6-941d979f0222 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.312998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d70e0-644f-421e-9ba6-941d979f0222 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.367246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.367851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.368125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.368395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.369037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.371482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.392283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1204/2390] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:41 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:41.396174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.406403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f93f-921d-47d1-92bf-addf6ca8b243 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.410943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.411542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.411819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.412091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.412778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.414397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.424672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1187/2391] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:41.428755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.438949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03f7d7-0dec-4971-beae-d01341383969 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.443447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.444094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.444372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.444643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] PATH_INFO: `/v3/projects/451f337c5c9f4d609b8f85abc4f1f05c/users/435528ea34ea48ac8cfd41505d1a2c06/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.460805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=451f337c5c9f4d609b8f85abc4f1f05c, user_id=435528ea34ea48ac8cfd41505d1a2c06, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.463535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.476522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1205/2392] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:41 2022] PUT /identity/v3/projects/451f337c5c9f4d609b8f85abc4f1f05c/users/435528ea34ea48ac8cfd41505d1a2c06/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:41.480433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.490416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c822-4e17-4f30-8a27-09bc8d40d11a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.546064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1492d-5c8c-4858-9368-94029ecc42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.546707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1492d-5c8c-4858-9368-94029ecc42a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.546987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1492d-5c8c-4858-9368-94029ecc42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.547261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1492d-5c8c-4858-9368-94029ecc42a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.547948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1492d-5c8c-4858-9368-94029ecc42a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.549536 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1492d-5c8c-4858-9368-94029ecc42a5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.559833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1188/2393] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:41.563860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.574458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7529-7052-48b2-a0e5-d154b03ec93b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.579005 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.579658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.579937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.580205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] PATH_INFO: `/v3/projects/451f337c5c9f4d609b8f85abc4f1f05c/users/435528ea34ea48ac8cfd41505d1a2c06/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.582150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] RBAC: Authorizing `identity:create_grant(project_id=451f337c5c9f4d609b8f85abc4f1f05c, user_id=435528ea34ea48ac8cfd41505d1a2c06, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.584787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.594861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1206/2394] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:41 2022] PUT /identity/v3/projects/451f337c5c9f4d609b8f85abc4f1f05c/users/435528ea34ea48ac8cfd41505d1a2c06/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:41.604857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.605145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.605419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.634306 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] MFA Rules not processed for user `435528ea34ea48ac8cfd41505d1a2c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:41.636357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:41.696204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:41.706954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1189/2395] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:41.717986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:41.719834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:41.776657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d24f-a449-4a36-835e-344aaea8786a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:41.780345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:41.780955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:41.781231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:41.781500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:41.790270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:41.792192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:41.797063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:41.801981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1207/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:42.296941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:42.298392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:42.310727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ceb4-a135-4ffa-a72a-9afe6c9bd1fe None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:42.314319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:42.314935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:42.315213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:42.315512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:42.371893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:42.373320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:42.382442 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1190/2397] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:43.771415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:43.780760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d5fe1-1346-4c34-9232-51d512ea2541 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:43.784416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:43.785021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:43.785298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:43.785566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:43.787336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:43.847328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:43.848756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:43.858462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1208/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:46.617558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:46.632735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1081fc5-3fb6-48ba-bcf2-b9157424c707 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:46.643310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e361a-000d-4af7-9dea-f80ad591072f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:46.644531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e361a-000d-4af7-9dea-f80ad591072f service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:46.644886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e361a-000d-4af7-9dea-f80ad591072f service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:46.645154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e361a-000d-4af7-9dea-f80ad591072f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:46.769809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e361a-000d-4af7-9dea-f80ad591072f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:46.771482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e361a-000d-4af7-9dea-f80ad591072f service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:46.789610 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1191/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:49.026658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:49.107725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f5bda-c4a7-4a69-82f8-037a90928f65 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:49.112919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:49.113618 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:49.113902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:49.114170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] PATH_INFO: `/v3/users/0e536f58dade4f0ab5d2910526d0884b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:49.115376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e536f58dade4f0ab5d2910526d0884b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:49.117425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:49.176076 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e536f58dade4f0ab5d2910526d0884b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.176173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e536f58dade4f0ab5d2910526d0884b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.187367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e536f58dade4f0ab5d2910526d0884b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.198912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e536f58dade4f0ab5d2910526d0884b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.214758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e536f58dade4f0ab5d2910526d0884b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.221792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1209/2400] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:49 2022] DELETE /identity/v3/users/0e536f58dade4f0ab5d2910526d0884b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:49.226299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48cf32-d861-4634-82b2-5cd8a2b4f213 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:49.226769 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48cf32-d861-4634-82b2-5cd8a2b4f213 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:49.226852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48cf32-d861-4634-82b2-5cd8a2b4f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:49.248247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-5a48cf32-d861-4634-82b2-5cd8a2b4f213 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:49.253179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5a48cf32-d861-4634-82b2-5cd8a2b4f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:49.344363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1192/2401] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:49.351631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:49.353157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:49.375508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:49.422596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016acb4f-6b7a-4b67-a4a8-263bec8d8da7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:49.428837 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:49.430091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:49.430421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:49.430692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:49.446155 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:49.447752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:49.458741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1210/2402] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:49.685140 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09361ba-ae29-445a-80bb-f5d0c237ca1a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:49.685607 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09361ba-ae29-445a-80bb-f5d0c237ca1a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:49.686031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09361ba-ae29-445a-80bb-f5d0c237ca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:49.705759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e09361ba-ae29-445a-80bb-f5d0c237ca1a None None] MFA Rules not processed for user `d5ad25c3f42e4ac2ad52592d55f94bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:49.707088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e09361ba-ae29-445a-80bb-f5d0c237ca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:49.737922 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:49.757546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:49.759083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:49.774135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf573-a673-4ec8-908d-7dbe6fb57aa5 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:49.774337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1193/2403] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:49.779403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:49.780041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:49.780326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:49.780713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] PATH_INFO: `/v3/projects/b84923a2141849788cb623fdaa37b544` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:49.781767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84923a2141849788cb623fdaa37b544)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:49.783701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:49.834125 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84923a2141849788cb623fdaa37b544', 'request_id': 'req-17e2ff1c-b6fd-4186-9319-4279b73a1edc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.843030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84923a2141849788cb623fdaa37b544', 'request_id': 'req-17e2ff1c-b6fd-4186-9319-4279b73a1edc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.848939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84923a2141849788cb623fdaa37b544', 'request_id': 'req-17e2ff1c-b6fd-4186-9319-4279b73a1edc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.860883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] The token cache is being invalidate because project b84923a2141849788cb623fdaa37b544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:49.861274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.861995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.863651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1211/2404] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:49 2022] DELETE /identity/v3/projects/b84923a2141849788cb623fdaa37b544 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:22:49.867540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09361ba-ae29-445a-80bb-f5d0c237ca1a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:49.879195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09361ba-ae29-445a-80bb-f5d0c237ca1a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:49.941286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:49.941854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:49.942150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:49.942431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] PATH_INFO: `/v3/users/6e3ab7bdd6eb4207ae17b7858e553389` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:49.943601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3ab7bdd6eb4207ae17b7858e553389)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:49.945556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:49.993304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3ab7bdd6eb4207ae17b7858e553389'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:49.993978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3ab7bdd6eb4207ae17b7858e553389'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.002276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3ab7bdd6eb4207ae17b7858e553389'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.003215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3ab7bdd6eb4207ae17b7858e553389'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.015604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3ab7bdd6eb4207ae17b7858e553389'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.029097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1194/2405] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:49 2022] DELETE /identity/v3/users/6e3ab7bdd6eb4207ae17b7858e553389 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:50.579824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:50.581405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:50.596992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ff1c-b6fd-4186-9319-4279b73a1edc admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:50.673088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:50.673736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:50.674019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:50.674441 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] PATH_INFO: `/v3/projects/83fdaab74a5743f9bdb8077d17905481` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:50.675577 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=83fdaab74a5743f9bdb8077d17905481)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:50.677661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:50.735302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:50.738787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83fdaab74a5743f9bdb8077d17905481', 'request_id': 'req-e4764945-37c2-4bc1-a75f-804b7331eaba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.750984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83fdaab74a5743f9bdb8077d17905481', 'request_id': 'req-e4764945-37c2-4bc1-a75f-804b7331eaba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.765141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83fdaab74a5743f9bdb8077d17905481', 'request_id': 'req-e4764945-37c2-4bc1-a75f-804b7331eaba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.778316 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] The token cache is being invalidate because project 83fdaab74a5743f9bdb8077d17905481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:50.778714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.779614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.781692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1212/2406] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:50 2022] DELETE /identity/v3/projects/83fdaab74a5743f9bdb8077d17905481 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:50.785800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:50.787556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:50.805088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f88a-df3c-4571-9417-952f46f052e2 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:50.888847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:50.896736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:50.897347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:50.897714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:50.897979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] PATH_INFO: `/v3/users/435528ea34ea48ac8cfd41505d1a2c06` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:50.901534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=435528ea34ea48ac8cfd41505d1a2c06)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:50.904673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:50.955611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435528ea34ea48ac8cfd41505d1a2c06'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.956201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435528ea34ea48ac8cfd41505d1a2c06'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.963684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435528ea34ea48ac8cfd41505d1a2c06'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.964314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435528ea34ea48ac8cfd41505d1a2c06'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.975930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b512ddf7-3ed3-4d51-b518-6ae0de381e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435528ea34ea48ac8cfd41505d1a2c06'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:50.988766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1195/2407] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:50 2022] DELETE /identity/v3/users/435528ea34ea48ac8cfd41505d1a2c06 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:51.255768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:51.257219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:51.275737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4764945-37c2-4bc1-a75f-804b7331eaba admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:51.334600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:51.335246 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.335545 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.335841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] PATH_INFO: `/v3/projects/451f337c5c9f4d609b8f85abc4f1f05c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.337554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] RBAC: Authorizing `identity:delete_project(project_id=451f337c5c9f4d609b8f85abc4f1f05c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:51.339520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:51.385936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451f337c5c9f4d609b8f85abc4f1f05c', 'request_id': 'req-89857891-5c1b-467a-86f8-8ef93ba6777a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:51.392528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451f337c5c9f4d609b8f85abc4f1f05c', 'request_id': 'req-89857891-5c1b-467a-86f8-8ef93ba6777a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:51.398102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451f337c5c9f4d609b8f85abc4f1f05c', 'request_id': 'req-89857891-5c1b-467a-86f8-8ef93ba6777a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:51.409038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] The token cache is being invalidate because project 451f337c5c9f4d609b8f85abc4f1f05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:51.409330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:51.409959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-89857891-5c1b-467a-86f8-8ef93ba6777a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:51.411482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1213/2408] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:51 2022] DELETE /identity/v3/projects/451f337c5c9f4d609b8f85abc4f1f05c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:51.417516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb39e-8772-4546-a01f-da2982bdb5d5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.417809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb39e-8772-4546-a01f-da2982bdb5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.418085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4eb39e-8772-4546-a01f-da2982bdb5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.438793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-fc4eb39e-8772-4546-a01f-da2982bdb5d5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:51.440007 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fc4eb39e-8772-4546-a01f-da2982bdb5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:51.499900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1196/2409] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:51.566109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7874df-90d3-421e-a673-43e57c1f600a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.566429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7874df-90d3-421e-a673-43e57c1f600a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.566703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7874df-90d3-421e-a673-43e57c1f600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.586194 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-fb7874df-90d3-421e-a673-43e57c1f600a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:51.587437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fb7874df-90d3-421e-a673-43e57c1f600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:51.595886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1214/2410] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:51.600285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb39e-8772-4546-a01f-da2982bdb5d5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:51.610905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4eb39e-8772-4546-a01f-da2982bdb5d5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:51.615888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:51.616509 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.616790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.617062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.617762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:22:51.618068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:51.620286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:51.635984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1197/2411] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:22:51.640295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7874df-90d3-421e-a673-43e57c1f600a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:51.649537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7874df-90d3-421e-a673-43e57c1f600a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:51.654282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:51.654895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.655175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.655450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.656103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:51.658038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:51.685772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1215/2412] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:51 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:51.690223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:51.700243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038f94-8907-4eec-adee-71b069960bfa admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:51.759054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:51.759595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.759907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.760183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.760858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:51.762823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:51.772751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:51.787668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1198/2413] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:51 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:51.788796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:51.799836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38bed-6704-4355-ac5a-1911bc84de0f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:51.804417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:51.805018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.805291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.805557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.806256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:51.808483 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:51.818156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1216/2414] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:51.822155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:51.832197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19f93-0c7a-410b-bb22-6c18167bdeb3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:51.836882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a73721-c068-4ac3-93e3-42df5593617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:51.837482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a73721-c068-4ac3-93e3-42df5593617f admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.837761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a73721-c068-4ac3-93e3-42df5593617f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.838598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a73721-c068-4ac3-93e3-42df5593617f admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.839286 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a73721-c068-4ac3-93e3-42df5593617f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:51.840855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a73721-c068-4ac3-93e3-42df5593617f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:51.851232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1199/2415] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:22:51.855935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:51.865792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5d920-88a4-4cda-960d-8d19db51d961 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:51.870477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:51.871127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.871409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.871682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] PATH_INFO: `/v3/projects/d7a0453e6c1e433caab479af0ee9e62b/users/9708fc320944449b9a6dd72266b190e7/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.886101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a0453e6c1e433caab479af0ee9e62b, user_id=9708fc320944449b9a6dd72266b190e7, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:51.888820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:51.897715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:51.904037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1217/2416] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:51 2022] PUT /identity/v3/projects/d7a0453e6c1e433caab479af0ee9e62b/users/9708fc320944449b9a6dd72266b190e7/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:51.915289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b27c6-4703-46d4-964d-6bbe04675872 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:51.915573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b27c6-4703-46d4-964d-6bbe04675872 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:51.915845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b27c6-4703-46d4-964d-6bbe04675872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:51.944229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d95b27c6-4703-46d4-964d-6bbe04675872 None None] MFA Rules not processed for user `9708fc320944449b9a6dd72266b190e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:51.945420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d95b27c6-4703-46d4-964d-6bbe04675872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:52.010741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1200/2417] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:52.015352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.078450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a93b-a2d1-4b85-a207-f165fa0adde5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.083272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.083892 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.084174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.084451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.085115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.087087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.126279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1218/2418] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:52 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:52.130511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b27c6-4703-46d4-964d-6bbe04675872 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.142518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b27c6-4703-46d4-964d-6bbe04675872 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.205077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.205697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.205976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.206348 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.206998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.208944 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.231315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1201/2419] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:52 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:52.235300 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.245401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e2fe6-c353-4038-9c51-60f00c10a02c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.257266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.257953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.258256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.258541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.259244 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.261499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.272371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1219/2420] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:52.277272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.287287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fe19-b526-4ae8-b78b-4f762683a73b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.291829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.292488 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.292765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.293033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] PATH_INFO: `/v3/projects/43cb48179b7046ce8a48b42776f59e2a/users/05ffc6f23886478997c0410b5318daa9/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.307927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cb48179b7046ce8a48b42776f59e2a, user_id=05ffc6f23886478997c0410b5318daa9, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.310611 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.324749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1202/2421] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:52 2022] PUT /identity/v3/projects/43cb48179b7046ce8a48b42776f59e2a/users/05ffc6f23886478997c0410b5318daa9/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:52.328665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.340122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8c43-4b4e-4e81-b843-d0829e9222a0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.401460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5718-ce08-4b06-a090-9b58ab15f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.402078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5718-ce08-4b06-a090-9b58ab15f9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.402400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5718-ce08-4b06-a090-9b58ab15f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.402674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5718-ce08-4b06-a090-9b58ab15f9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.403367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5718-ce08-4b06-a090-9b58ab15f9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.404987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5718-ce08-4b06-a090-9b58ab15f9f7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.415032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1220/2422] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:22:52.419161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.429354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f3c44-105b-49ef-a6da-790b2f5b82bb admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.433976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.434698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.434981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.435253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] PATH_INFO: `/v3/projects/43cb48179b7046ce8a48b42776f59e2a/users/05ffc6f23886478997c0410b5318daa9/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.437244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cb48179b7046ce8a48b42776f59e2a, user_id=05ffc6f23886478997c0410b5318daa9, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.439926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.450819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1203/2423] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:52 2022] PUT /identity/v3/projects/43cb48179b7046ce8a48b42776f59e2a/users/05ffc6f23886478997c0410b5318daa9/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:52.462126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8378fb-e6dc-4451-83bc-227ac2ec8295 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.462440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8378fb-e6dc-4451-83bc-227ac2ec8295 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.462715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8378fb-e6dc-4451-83bc-227ac2ec8295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.490379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0e8378fb-e6dc-4451-83bc-227ac2ec8295 None None] MFA Rules not processed for user `05ffc6f23886478997c0410b5318daa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:52.491579 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0e8378fb-e6dc-4451-83bc-227ac2ec8295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:52.551839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:52.561667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1221/2424] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:52.573594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.575351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:52.603076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:52.633431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4543e-51c1-4df8-9a37-1e6a50a2bd27 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.637662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.638299 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.638585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.638857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.648341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.649780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.659761 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1204/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:52.743433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8378fb-e6dc-4451-83bc-227ac2ec8295 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:52.753717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8378fb-e6dc-4451-83bc-227ac2ec8295 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:52.757226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e1fa5-6a76-446c-b7c2-2868c6fb3151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:52.757828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1fa5-6a76-446c-b7c2-2868c6fb3151 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:52.758100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1fa5-6a76-446c-b7c2-2868c6fb3151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:52.758406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1fa5-6a76-446c-b7c2-2868c6fb3151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:52.813720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e1fa5-6a76-446c-b7c2-2868c6fb3151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:52.815097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e1fa5-6a76-446c-b7c2-2868c6fb3151 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:52.824444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1222/2426] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:57.849992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:57.877352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467de72-b4af-4aa4-b683-60568ffdbb2b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:57.878128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467de72-b4af-4aa4-b683-60568ffdbb2b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:57.878128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467de72-b4af-4aa4-b683-60568ffdbb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:57.898969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-5467de72-b4af-4aa4-b683-60568ffdbb2b None None] MFA Rules not processed for user `64d2c283ac35442ebd3c46569d8062c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:57.900271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5467de72-b4af-4aa4-b683-60568ffdbb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:57.916404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383058-cc4e-44e7-807f-05ec5f76d025 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:57.926568 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:57.927223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:57.927501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:57.927777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] PATH_INFO: `/v3/users/9708fc320944449b9a6dd72266b190e7` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:57.928969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9708fc320944449b9a6dd72266b190e7)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:57.930929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:57.957286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1223/2427] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:22:57.983902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9708fc320944449b9a6dd72266b190e7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:57.984560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9708fc320944449b9a6dd72266b190e7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:57.992513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9708fc320944449b9a6dd72266b190e7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:57.993157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9708fc320944449b9a6dd72266b190e7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.007088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9708fc320944449b9a6dd72266b190e7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.020882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1205/2428] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:57 2022] DELETE /identity/v3/users/9708fc320944449b9a6dd72266b190e7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:58.025509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:58.025792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:58.026064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:58.044957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:58.046151 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:58.104271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1224/2429] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:58.114041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:58.115489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:58.171954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:58.179358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20a83d-0286-4eac-9229-d9b14d8a375c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:58.184496 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:58.185122 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:58.185399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:58.185670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:58.195103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:58.196543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:58.206952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1206/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:22:58.691085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:58.692504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:58.705016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f5b73-5858-486b-b357-b973d16974d4 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:58.710040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:58.710715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:58.710993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:58.711262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] PATH_INFO: `/v3/projects/d7a0453e6c1e433caab479af0ee9e62b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:58.712413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a0453e6c1e433caab479af0ee9e62b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:58.714924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:58.780462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:58.794223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a0453e6c1e433caab479af0ee9e62b', 'request_id': 'req-b1ff9bff-033a-4a91-98a3-3c5057e0825c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.803612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a0453e6c1e433caab479af0ee9e62b', 'request_id': 'req-b1ff9bff-033a-4a91-98a3-3c5057e0825c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.810371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a0453e6c1e433caab479af0ee9e62b', 'request_id': 'req-b1ff9bff-033a-4a91-98a3-3c5057e0825c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.822963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] The token cache is being invalidate because project d7a0453e6c1e433caab479af0ee9e62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:58.823239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.825523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.830301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1225/2431] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:58 2022] DELETE /identity/v3/projects/d7a0453e6c1e433caab479af0ee9e62b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:58.831095 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:58.841840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f57a16-c7fa-48a9-b100-923762a89224 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:58.930758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:58.931474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:58.931716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:58.932030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] PATH_INFO: `/v3/users/05ffc6f23886478997c0410b5318daa9` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:58.933225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ffc6f23886478997c0410b5318daa9)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:58.935486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:58.988523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ffc6f23886478997c0410b5318daa9'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.989343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ffc6f23886478997c0410b5318daa9'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.998319 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ffc6f23886478997c0410b5318daa9'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:58.999494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ffc6f23886478997c0410b5318daa9'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:59.019766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-be854f21-13e0-477c-b72f-4a8a14ac63f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ffc6f23886478997c0410b5318daa9'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:59.037554 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1207/2432] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:22:58 2022] DELETE /identity/v3/users/05ffc6f23886478997c0410b5318daa9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:22:59.329991 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:59.332231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:59.349899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9bff-033a-4a91-98a3-3c5057e0825c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:59.419389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:59.420026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.420299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.420565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] PATH_INFO: `/v3/projects/43cb48179b7046ce8a48b42776f59e2a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.421693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cb48179b7046ce8a48b42776f59e2a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:59.423629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:59.468261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cb48179b7046ce8a48b42776f59e2a', 'request_id': 'req-ec269121-cba9-47e3-aa1f-f5d2fe83713d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:59.475176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cb48179b7046ce8a48b42776f59e2a', 'request_id': 'req-ec269121-cba9-47e3-aa1f-f5d2fe83713d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:59.480742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cb48179b7046ce8a48b42776f59e2a', 'request_id': 'req-ec269121-cba9-47e3-aa1f-f5d2fe83713d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:59.491421 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] The token cache is being invalidate because project 43cb48179b7046ce8a48b42776f59e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:22:59.491726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:59.492354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-ec269121-cba9-47e3-aa1f-f5d2fe83713d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:22:59.494462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1226/2433] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:22:59 2022] DELETE /identity/v3/projects/43cb48179b7046ce8a48b42776f59e2a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:22:59.499435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d6b6-9711-437a-9573-193ee5d99a9b None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.499647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d6b6-9711-437a-9573-193ee5d99a9b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.499929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d6b6-9711-437a-9573-193ee5d99a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.519744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-da58d6b6-9711-437a-9573-193ee5d99a9b None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:59.520951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-da58d6b6-9711-437a-9573-193ee5d99a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:59.578636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1208/2434] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:59.586564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233089-d167-48e3-b1e3-5eafa770d0ba None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.586850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233089-d167-48e3-b1e3-5eafa770d0ba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.587122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce233089-d167-48e3-b1e3-5eafa770d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.608062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-ce233089-d167-48e3-b1e3-5eafa770d0ba None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:22:59.609274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ce233089-d167-48e3-b1e3-5eafa770d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:22:59.617585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1227/2435] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:22:59.622189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d6b6-9711-437a-9573-193ee5d99a9b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:59.632086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d6b6-9711-437a-9573-193ee5d99a9b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:59.637293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:59.637887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.638168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.638471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.639193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:22:59.639498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:59.641089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:59.643428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:22:59.658185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1209/2436] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:22:59.659127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce233089-d167-48e3-b1e3-5eafa770d0ba None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:59.668335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce233089-d167-48e3-b1e3-5eafa770d0ba None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:59.673032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:59.673633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.673911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.674181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.674875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:59.676763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:59.705351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1228/2437] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:22:59 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:22:59.709830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:59.720010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c14c-1eb6-42ac-9e3f-79c1d3c92c72 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:59.788216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:59.788852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.789341 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.789628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.790466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:59.793787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:59.825703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1210/2438] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:22:59 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:22:59.829731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:59.849466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eff30d-9ffb-45dc-884b-6a7fb98273f7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:59.856760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:59.857712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.857712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.857934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.858528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:59.860135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:59.874291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1229/2439] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:59.876403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:59.922352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3cce-39e6-4e86-ab7a-1179b8b9b47f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:59.935954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832439d8-34ae-42ac-90a8-74d0bab0ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:59.936609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832439d8-34ae-42ac-90a8-74d0bab0ae94 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.937009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832439d8-34ae-42ac-90a8-74d0bab0ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.937923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832439d8-34ae-42ac-90a8-74d0bab0ae94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:22:59.938668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832439d8-34ae-42ac-90a8-74d0bab0ae94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:22:59.941756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832439d8-34ae-42ac-90a8-74d0bab0ae94 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:22:59.958769 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1211/2440] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:22:59.959862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:22:59.972704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f542bf7-10a7-42eb-baa5-be8ea7a7fa3a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:22:59.988721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:22:59.989573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:22:59.989994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:22:59.990184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] PATH_INFO: `/v3/projects/902aafa8c412445589553aa8069271f9/users/6209bf2a78fe471599a099ee65611c76/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:00.004505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:23:00.009298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=902aafa8c412445589553aa8069271f9, user_id=6209bf2a78fe471599a099ee65611c76, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:00.012253 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:00.032987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1230/2441] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:22:59 2022] PUT /identity/v3/projects/902aafa8c412445589553aa8069271f9/users/6209bf2a78fe471599a099ee65611c76/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:23:00.037859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6d28-49ae-4738-bb5d-afc15e08c5f1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:00.038143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6d28-49ae-4738-bb5d-afc15e08c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:00.038451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6d28-49ae-4738-bb5d-afc15e08c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:00.059185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ba8b6d28-49ae-4738-bb5d-afc15e08c5f1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:00.060460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ba8b6d28-49ae-4738-bb5d-afc15e08c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:00.134346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1212/2442] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:00.146815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:00.148697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:00.226077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a10710-b9e3-4828-a277-64bd992c9f9e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:00.230504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:00.231120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:00.231393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:00.231660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:00.240979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:00.242418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:00.252328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1231/2443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:23:01.305288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b89d42-358d-4223-9115-f01792875a2a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:01.305877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b89d42-358d-4223-9115-f01792875a2a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:01.305877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b89d42-358d-4223-9115-f01792875a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:01.335449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e9b89d42-358d-4223-9115-f01792875a2a None None] MFA Rules not processed for user `6209bf2a78fe471599a099ee65611c76`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:01.336579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e9b89d42-358d-4223-9115-f01792875a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:01.411540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1213/2444] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:23:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:01.424153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:01.425776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:01.490270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32495b8e-f422-485f-86df-bcbbcdc55952 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:01.494667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:01.495620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:01.495620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:01.495820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:01.504583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:01.506013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:01.516043 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1232/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:23:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:23:02.994390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:02.994965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:02.994965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:03.003210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:23:03.015718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] MFA Rules not processed for user `6209bf2a78fe471599a099ee65611c76`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:03.017135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:03.024117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1214/2446] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:23:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:03.062045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:03.063566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:03.162696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f506-9204-4e96-a9e0-0ccfd3e54b04 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:03.168830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2c7a-eca2-4037-831b-42b805dc2a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:03.169451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2c7a-eca2-4037-831b-42b805dc2a80 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:03.169750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2c7a-eca2-4037-831b-42b805dc2a80 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:03.170020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2c7a-eca2-4037-831b-42b805dc2a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:03.171826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a8fe2c7a-eca2-4037-831b-42b805dc2a80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:03.183828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2c7a-eca2-4037-831b-42b805dc2a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:03.185411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2c7a-eca2-4037-831b-42b805dc2a80 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:03.195942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1233/2447] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:23:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:23:08.697219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:08.698673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:08.715710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002dfe3-9af0-4d67-946f-d6908a1aa6fe None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:08.721239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa925ca-1765-4bea-b2e1-428f4b2caa4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:08.721865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa925ca-1765-4bea-b2e1-428f4b2caa4d service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:08.722145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa925ca-1765-4bea-b2e1-428f4b2caa4d service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:08.722444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa925ca-1765-4bea-b2e1-428f4b2caa4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:08.724345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bfa925ca-1765-4bea-b2e1-428f4b2caa4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:08.737701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa925ca-1765-4bea-b2e1-428f4b2caa4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:08.739357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa925ca-1765-4bea-b2e1-428f4b2caa4d service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:08.751240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1215/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:23:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:23:13.191479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:23:18.745826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:23:24.096669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:24.097135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:24.097243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:24.116318 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] MFA Rules not processed for user `6209bf2a78fe471599a099ee65611c76`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:24.117521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:24.124427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1234/2449] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:23:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:34.110824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:23:40.718318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8ab1-251f-4ae6-a957-e547b8075e12 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:40.718857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8ab1-251f-4ae6-a957-e547b8075e12 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:40.718857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8ab1-251f-4ae6-a957-e547b8075e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:40.751836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-727f8ab1-251f-4ae6-a957-e547b8075e12 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:40.753522 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-727f8ab1-251f-4ae6-a957-e547b8075e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:40.815670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1216/2450] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:23:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:40.861793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:40.863242 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:40.938211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d341b7-e319-42f7-81da-f3d6d39a28fd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:40.944551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:40.945167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:40.945442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:40.945712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:40.955198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:40.956755 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:40.964648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1235/2451] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:23:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:23:43.091398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aec61-8955-4614-961d-ada5fde3b922 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:43.091876 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aec61-8955-4614-961d-ada5fde3b922 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:43.091983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aec61-8955-4614-961d-ada5fde3b922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:43.112220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8f5aec61-8955-4614-961d-ada5fde3b922 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:43.113427 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8f5aec61-8955-4614-961d-ada5fde3b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:43.121045 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1217/2452] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:23:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:43.138099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:43.150752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36e73f-e36d-4e09-b353-75ba6e3f62c6 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:43.156319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f921308-5650-45c3-96a0-9b3561d81b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:43.157210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f921308-5650-45c3-96a0-9b3561d81b13 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:43.157666 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f921308-5650-45c3-96a0-9b3561d81b13 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:43.158111 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f921308-5650-45c3-96a0-9b3561d81b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:43.167158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f921308-5650-45c3-96a0-9b3561d81b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:43.168990 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f921308-5650-45c3-96a0-9b3561d81b13 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:43.180063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1236/2453] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:23:53.112547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=28 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:23:53.174831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=38 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:23:57.044390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e7bb-f695-46fc-86e0-59b9c8037d79 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.045403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e7bb-f695-46fc-86e0-59b9c8037d79 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.046256 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e7bb-f695-46fc-86e0-59b9c8037d79 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.047578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1218/2454] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:23:57.057128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2a3a-473d-4ccd-8dfc-09df7a672e69 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.058059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2a3a-473d-4ccd-8dfc-09df7a672e69 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.058518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2a3a-473d-4ccd-8dfc-09df7a672e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.157343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-77ae2a3a-473d-4ccd-8dfc-09df7a672e69 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:57.159078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-77ae2a3a-473d-4ccd-8dfc-09df7a672e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:57.250288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1237/2455] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:57.263166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98e7bb-f695-46fc-86e0-59b9c8037d79 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:57.265583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ca98e7bb-f695-46fc-86e0-59b9c8037d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:57.331624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98e7bb-f695-46fc-86e0-59b9c8037d79 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:57.335530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877b0f9-78e0-4482-9278-4cbbd468c3aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:57.336174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b0f9-78e0-4482-9278-4cbbd468c3aa service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.336455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b0f9-78e0-4482-9278-4cbbd468c3aa service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.336725 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b0f9-78e0-4482-9278-4cbbd468c3aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.349657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877b0f9-78e0-4482-9278-4cbbd468c3aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:57.351211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877b0f9-78e0-4482-9278-4cbbd468c3aa service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:57.363292 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1219/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:23:57.448250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed767-434a-4050-a6a7-9c7b26997dba None None] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.449057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed767-434a-4050-a6a7-9c7b26997dba None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.449590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed767-434a-4050-a6a7-9c7b26997dba None None] PATH_INFO: `/` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.451552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1238/2457] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:23:57.460435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5263241-4dd8-427b-8492-fb53c4575d43 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.461078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5263241-4dd8-427b-8492-fb53c4575d43 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.461921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5263241-4dd8-427b-8492-fb53c4575d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.494443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d5263241-4dd8-427b-8492-fb53c4575d43 None None] MFA Rules not processed for user `ba7594ae41184fb09cd2399b7f35616e`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:57.496038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d5263241-4dd8-427b-8492-fb53c4575d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:57.509035 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1220/2458] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:57.521637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed767-434a-4050-a6a7-9c7b26997dba None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:57.523361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-af4ed767-434a-4050-a6a7-9c7b26997dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:57.536687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed767-434a-4050-a6a7-9c7b26997dba None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:57.540757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327889f-a6a6-47bf-bb40-d9cefd2c9785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:57.541394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327889f-a6a6-47bf-bb40-d9cefd2c9785 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.541671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327889f-a6a6-47bf-bb40-d9cefd2c9785 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.542053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327889f-a6a6-47bf-bb40-d9cefd2c9785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.553714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327889f-a6a6-47bf-bb40-d9cefd2c9785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:57.555173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327889f-a6a6-47bf-bb40-d9cefd2c9785 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:57.564132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1239/2459] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:23:57.659328 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f25b1-eb27-48c0-be0a-bfbcecf42d40 None None] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.660421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f25b1-eb27-48c0-be0a-bfbcecf42d40 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.661189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f25b1-eb27-48c0-be0a-bfbcecf42d40 None None] PATH_INFO: `/` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.665614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1221/2460] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 28 22:23:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 22:23:57.674800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656c8bb-b656-44ad-b9a8-91e2f183eb70 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.675430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656c8bb-b656-44ad-b9a8-91e2f183eb70 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.675949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656c8bb-b656-44ad-b9a8-91e2f183eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.704292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-8656c8bb-b656-44ad-b9a8-91e2f183eb70 None None] MFA Rules not processed for user `cf0b530da35f445d8241c16d8f51b16b`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:57.706501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8656c8bb-b656-44ad-b9a8-91e2f183eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:57.717164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1240/2461] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 28 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:57.737542 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f25b1-eb27-48c0-be0a-bfbcecf42d40 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:57.751189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f25b1-eb27-48c0-be0a-bfbcecf42d40 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:57.758989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:57.762357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:57.762895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:57.763405 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:57.778481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:57.780274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:57.793246 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1222/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:23:58.786707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a8538-2dcc-4a50-853f-1e137a658f92 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:58.787216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a8538-2dcc-4a50-853f-1e137a658f92 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:58.787319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a8538-2dcc-4a50-853f-1e137a658f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:58.805847 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-439a8538-2dcc-4a50-853f-1e137a658f92 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:58.807097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-439a8538-2dcc-4a50-853f-1e137a658f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:58.814290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1241/2463] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 28 22:23:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:58.826744 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:58.838432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e54fdb-e6fc-4891-a560-a4c7c4c5d0a7 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:58.843999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:58.844605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:58.844881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:58.845143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:58.853308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:58.854901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:58.862855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1223/2464] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:23:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:23:59.625305 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1100e7b-d789-45b2-b889-8bea8ffab5ee None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:59.625708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1100e7b-d789-45b2-b889-8bea8ffab5ee None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:59.625985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1100e7b-d789-45b2-b889-8bea8ffab5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:59.644916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b1100e7b-d789-45b2-b889-8bea8ffab5ee None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:23:59.646103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b1100e7b-d789-45b2-b889-8bea8ffab5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:23:59.653115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1242/2465] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:23:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:23:59.665156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:23:59.676170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56603d76-1ec0-490b-912d-0372b5621259 service swift] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:23:59.681183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:23:59.681788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:23:59.682068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:23:59.682371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:23:59.690804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:23:59.692364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:23:59.700446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1224/2466] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:23:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:24:00.964561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1100e7b-d789-45b2-b889-8bea8ffab5ee None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.000775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1100e7b-d789-45b2-b889-8bea8ffab5ee None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:01.005630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:01.006293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.006571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.006838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] PATH_INFO: `/v3/users/6209bf2a78fe471599a099ee65611c76` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.008007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6209bf2a78fe471599a099ee65611c76)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:01.009893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:01.057871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6209bf2a78fe471599a099ee65611c76'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.058780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6209bf2a78fe471599a099ee65611c76'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.068575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6209bf2a78fe471599a099ee65611c76'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.076582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6209bf2a78fe471599a099ee65611c76'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.082045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:01.092236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-47e483f5-ae08-4021-ba81-8930607efed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6209bf2a78fe471599a099ee65611c76'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.105496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1243/2467] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:24:00 2022] DELETE /identity/v3/users/6209bf2a78fe471599a099ee65611c76 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:24:01.283023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.315813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080a0fa-4007-465b-a2c5-d6559ffb055b service swift] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:01.372212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:01.372873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.373171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.373433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] PATH_INFO: `/v3/projects/902aafa8c412445589553aa8069271f9` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.374715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902aafa8c412445589553aa8069271f9)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:01.376634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:01.428647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902aafa8c412445589553aa8069271f9', 'request_id': 'req-d8e1c357-459b-45bc-80a6-add8230db3c6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.435114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902aafa8c412445589553aa8069271f9', 'request_id': 'req-d8e1c357-459b-45bc-80a6-add8230db3c6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.440513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:01.443531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902aafa8c412445589553aa8069271f9', 'request_id': 'req-d8e1c357-459b-45bc-80a6-add8230db3c6'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.475254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] The token cache is being invalidate because project 902aafa8c412445589553aa8069271f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:24:01.475572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.476220 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d8e1c357-459b-45bc-80a6-add8230db3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:24:01.477786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1225/2468] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:24:01 2022] DELETE /identity/v3/projects/902aafa8c412445589553aa8069271f9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:24:01.484022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbdf65-d6ab-4a7f-9a36-f94251dc23f5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.484500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbdf65-d6ab-4a7f-9a36-f94251dc23f5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.484768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbdf65-d6ab-4a7f-9a36-f94251dc23f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.540439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-febbdf65-d6ab-4a7f-9a36-f94251dc23f5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:01.541667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-febbdf65-d6ab-4a7f-9a36-f94251dc23f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:01.603789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1244/2469] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:24:01.612830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23483f7-6492-46c3-a32e-e117099d5213 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.613145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23483f7-6492-46c3-a32e-e117099d5213 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.613412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23483f7-6492-46c3-a32e-e117099d5213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.634159 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-c23483f7-6492-46c3-a32e-e117099d5213 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:01.635429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c23483f7-6492-46c3-a32e-e117099d5213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:01.644171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1226/2470] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:01.648383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbdf65-d6ab-4a7f-9a36-f94251dc23f5 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.659375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbdf65-d6ab-4a7f-9a36-f94251dc23f5 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:01.664566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:01.665191 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.665467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.665739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.666471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:24:01.666776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:01.668647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:01.681643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1245/2471] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:24:01.686112 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23483f7-6492-46c3-a32e-e117099d5213 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.696613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23483f7-6492-46c3-a32e-e117099d5213 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:01.701907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:01.703218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.703501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.703777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.704456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:01.706406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:01.762163 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1227/2472] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:24:01 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:24:01.765474 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.778377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af819-807f-4969-8e52-776975d61036 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:01.851213 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:01.851985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.852463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.852705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.853432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:01.855350 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:01.881096 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1246/2473] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:24:01 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:24:01.887667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.907339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c44e4-1d1c-484b-ab64-af187d16fe93 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:01.914931 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:01.915580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.915863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.916385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.917108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:01.918894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:01.937185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1228/2474] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:24:01.941625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.953045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ee6d2-e8e9-4b08-9caa-dac5163ef8e6 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:01.960478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079dc13-7bd7-4a4f-a89d-8392eb4c25ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:01.961113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dc13-7bd7-4a4f-a89d-8392eb4c25ca admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:01.961506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dc13-7bd7-4a4f-a89d-8392eb4c25ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:01.961810 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dc13-7bd7-4a4f-a89d-8392eb4c25ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:01.962872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079dc13-7bd7-4a4f-a89d-8392eb4c25ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:01.964644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079dc13-7bd7-4a4f-a89d-8392eb4c25ca admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:01.981816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1247/2475] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:24:01.982431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:01.997241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c08c81-09be-4121-86ca-c4a582002984 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:02.002833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:02.003839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:02.004210 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:02.004564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] PATH_INFO: `/v3/projects/029af963b2db4473a1b3969ed5abf407/users/9bab35b69c92496ba7d3a9bbe33324fe/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:02.020758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] RBAC: Authorizing `identity:create_grant(project_id=029af963b2db4473a1b3969ed5abf407, user_id=9bab35b69c92496ba7d3a9bbe33324fe, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:02.023938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:02.042497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1229/2476] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:24:01 2022] PUT /identity/v3/projects/029af963b2db4473a1b3969ed5abf407/users/9bab35b69c92496ba7d3a9bbe33324fe/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:24:02.045802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4840c5-a11b-4942-a523-d9bcc090af46 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:02.046184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4840c5-a11b-4942-a523-d9bcc090af46 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:02.046686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4840c5-a11b-4942-a523-d9bcc090af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:02.069241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9d4840c5-a11b-4942-a523-d9bcc090af46 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:02.070490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9d4840c5-a11b-4942-a523-d9bcc090af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:02.099550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:02.146933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1248/2477] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:02.156659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:02.158432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:02.237713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ceb06-9d90-4615-9341-e79c61c6780b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:02.241346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:02.241966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:02.242277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:02.242560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:02.252957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:02.254704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:02.265158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1230/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:24:07.448703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ed26f-e745-47b3-9149-d98fe831b2ef None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:07.449310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ed26f-e745-47b3-9149-d98fe831b2ef None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:07.449310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ed26f-e745-47b3-9149-d98fe831b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:07.505706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d44ed26f-e745-47b3-9149-d98fe831b2ef None None] MFA Rules not processed for user `9bab35b69c92496ba7d3a9bbe33324fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:07.518289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d44ed26f-e745-47b3-9149-d98fe831b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:07.669686 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1249/2479] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:24:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:07.672079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:07.693614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7d0c8-8a9e-43f1-8961-53d3b1277c6c service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:07.707153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:07.708225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:07.708833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:07.709154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:07.710185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:07.713415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:07.774618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1231/2480] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:24:07 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:24:07.778110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ed26f-e745-47b3-9149-d98fe831b2ef None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:07.796460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ed26f-e745-47b3-9149-d98fe831b2ef None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:07.880291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:07.881201 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:07.881509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:07.881828 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:07.882630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:07.884777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:07.917153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1250/2481] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:24:07 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:24:07.918419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:07.929867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edac05-8899-4782-aebe-112edb3d71e4 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:07.938447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:07.938447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:07.938447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:07.938447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:07.939002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:07.942418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:07.972794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:07.973257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1232/2482] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:24:07.983868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d521f-066d-4ad9-9938-bc3e4363541c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:07.988775 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:07.989543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:07.989895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:07.990170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] PATH_INFO: `/v3/projects/3683af3a9b9349fbb61c4610a7eba691/users/88154e80600d4671b699a73545c7bf99/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:08.008787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3683af3a9b9349fbb61c4610a7eba691, user_id=88154e80600d4671b699a73545c7bf99, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:08.012691 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:08.029753 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1251/2483] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:24:07 2022] PUT /identity/v3/projects/3683af3a9b9349fbb61c4610a7eba691/users/88154e80600d4671b699a73545c7bf99/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:24:08.033559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:08.044766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337102e-4bb9-4188-a671-1d9a778576ac admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:08.090837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:08.120996 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e8894-1d77-4da5-bb05-f7a021e60147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:08.122073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8894-1d77-4da5-bb05-f7a021e60147 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:08.122461 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8894-1d77-4da5-bb05-f7a021e60147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:08.122740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8894-1d77-4da5-bb05-f7a021e60147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:08.123599 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e8894-1d77-4da5-bb05-f7a021e60147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:08.125980 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e8894-1d77-4da5-bb05-f7a021e60147 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:08.148982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1233/2484] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:24:08.153088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:08.164374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16980-2a89-49fd-9319-651268f1e94c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:08.169128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:08.169802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:08.170082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:08.170448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] PATH_INFO: `/v3/projects/3683af3a9b9349fbb61c4610a7eba691/users/88154e80600d4671b699a73545c7bf99/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:08.173124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3683af3a9b9349fbb61c4610a7eba691, user_id=88154e80600d4671b699a73545c7bf99, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:08.175824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:08.191319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1252/2485] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:24:08 2022] PUT /identity/v3/projects/3683af3a9b9349fbb61c4610a7eba691/users/88154e80600d4671b699a73545c7bf99/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:24:13.131775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81fd4-1de7-4154-8889-f153230c1f3b None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:13.132339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81fd4-1de7-4154-8889-f153230c1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:13.132339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81fd4-1de7-4154-8889-f153230c1f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:13.162297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9ff81fd4-1de7-4154-8889-f153230c1f3b None None] MFA Rules not processed for user `88154e80600d4671b699a73545c7bf99`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:13.163451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9ff81fd4-1de7-4154-8889-f153230c1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:13.233018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1234/2486] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:24:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:13.245646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:13.247526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:13.264398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:13.312874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03019785-4b0f-45bf-9009-cd86b09bdf5e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:13.316403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:13.317016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:13.317293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:13.317558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:13.376315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:13.380061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:13.388379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1253/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:24:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:24:13.511485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:13.511771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:13.512068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:13.538550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:13.539706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:13.618482 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1235/2488] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:24:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:13.634448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:13.636137 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:13.717293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b3c0-bde1-4928-ad4c-91273eb2c5f8 service glance] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:13.723341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be0340-8012-4ea1-8ca4-042cf9ce156b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:13.724060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be0340-8012-4ea1-8ca4-042cf9ce156b service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:13.724413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be0340-8012-4ea1-8ca4-042cf9ce156b service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:13.724754 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be0340-8012-4ea1-8ca4-042cf9ce156b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:13.734116 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be0340-8012-4ea1-8ca4-042cf9ce156b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:13.735891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be0340-8012-4ea1-8ca4-042cf9ce156b service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:13.745919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1254/2489] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:24:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:24:16.698437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:16.702048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:16.807216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:16.840941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3ddf1-6100-4721-b25a-1e1507945429 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:16.846937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:16.847703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:16.848052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:16.848404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:16.850699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:16.866243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:16.868858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:16.892688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1236/2490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:24:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:24:22.015060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dbe4-4bbc-411f-85ea-78c9110ae729 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:22.015672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dbe4-4bbc-411f-85ea-78c9110ae729 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:22.015672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dbe4-4bbc-411f-85ea-78c9110ae729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:22.036097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bbf5dbe4-4bbc-411f-85ea-78c9110ae729 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:22.037327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bbf5dbe4-4bbc-411f-85ea-78c9110ae729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:22.048608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1255/2491] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 28 22:24:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:22.069016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:22.081928 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5506-2868-496e-b168-9ea9d14f6af0 service placement] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:22.088391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b67ee-b890-45e8-84ca-0d47d9c68985 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:22.089029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b67ee-b890-45e8-84ca-0d47d9c68985 service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:22.089307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b67ee-b890-45e8-84ca-0d47d9c68985 service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:22.089577 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b67ee-b890-45e8-84ca-0d47d9c68985 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:22.102802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b67ee-b890-45e8-84ca-0d47d9c68985 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:22.104443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b67ee-b890-45e8-84ca-0d47d9c68985 service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:22.114455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1237/2492] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:24:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:24:22.848558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d4b1-6e22-4a08-878f-ceb9402e0af9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:22.848864 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d4b1-6e22-4a08-878f-ceb9402e0af9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:22.849133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d4b1-6e22-4a08-878f-ceb9402e0af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:22.868609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-97f1d4b1-6e22-4a08-878f-ceb9402e0af9 None None] MFA Rules not processed for user `9bab35b69c92496ba7d3a9bbe33324fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:22.869923 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-97f1d4b1-6e22-4a08-878f-ceb9402e0af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:22.878326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1256/2493] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:24:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:24.673992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:24.674530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:24.674749 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:24.694771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:24:24.696106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:24.705061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1238/2494] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:24:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:24:24.718488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d4b1-6e22-4a08-878f-ceb9402e0af9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:24.731210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d4b1-6e22-4a08-878f-ceb9402e0af9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:24.736639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:24.737282 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:24.737564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:24.737836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:24.746134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:24.747746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:24.756835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1257/2495] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:24:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:24:34.689759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=19 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:34.753144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:24:52.293560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:24:52.295024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:24:52.370823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3cabc-fdad-4b04-aa2f-ff5257b02fa5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:24:52.374360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:24:52.374969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:24:52.375244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:24:52.375513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:24:52.385386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:24:52.386830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:24:52.396239 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1239/2496] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:24:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:02.391910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=35 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:03.694840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:03.704174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3169d-fe10-4a96-87ce-872354ccfc06 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:03.708544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:03.709150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:03.709428 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:03.709697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:03.711492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:03.774459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:03.775907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:03.785941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1258/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:06.015499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:06.024435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520633b-85b4-4abc-ba82-d7287c9240e7 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:06.028105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:06.028707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:06.028983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:06.029250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:06.031043 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:06.043525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:06.044938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:06.055191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1240/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:07.133517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:07.135019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:07.153440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65d2b-a491-42d4-9f0e-0a02c0036093 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:07.158992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:07.160368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.160822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.161417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] PATH_INFO: `/v3/users/64d2c283ac35442ebd3c46569d8062c9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.163656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d2c283ac35442ebd3c46569d8062c9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:07.170475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:07.243884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d2c283ac35442ebd3c46569d8062c9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.244794 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d2c283ac35442ebd3c46569d8062c9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.253790 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d2c283ac35442ebd3c46569d8062c9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.262512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d2c283ac35442ebd3c46569d8062c9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.280290 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8acefeff-b61d-4607-a2b0-ccad62f4850d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d2c283ac35442ebd3c46569d8062c9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.286944 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1259/2499] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:07 2022] DELETE /identity/v3/users/64d2c283ac35442ebd3c46569d8062c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:07.463464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:07.480070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a93f8-15bb-4559-a536-dc83e5a714b7 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:07.549209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:07.549868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.550721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.551001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] PATH_INFO: `/v3/projects/4b9bacecb17b46369ce347a1ac45b0fb` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.552183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9bacecb17b46369ce347a1ac45b0fb)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:07.554094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:07.602768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9bacecb17b46369ce347a1ac45b0fb', 'request_id': 'req-5fe0f7be-a363-4d32-8e79-571f3b166a11'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.610334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9bacecb17b46369ce347a1ac45b0fb', 'request_id': 'req-5fe0f7be-a363-4d32-8e79-571f3b166a11'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.617200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9bacecb17b46369ce347a1ac45b0fb', 'request_id': 'req-5fe0f7be-a363-4d32-8e79-571f3b166a11'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.629692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] The token cache is being invalidate because project 4b9bacecb17b46369ce347a1ac45b0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:07.629985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.631001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-5fe0f7be-a363-4d32-8e79-571f3b166a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:07.632722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1241/2500] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:07 2022] DELETE /identity/v3/projects/4b9bacecb17b46369ce347a1ac45b0fb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:07.637514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9675a-f71d-4bdb-ac88-21cd549b5073 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.637806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9675a-f71d-4bdb-ac88-21cd549b5073 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.638075 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9675a-f71d-4bdb-ac88-21cd549b5073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.658468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3be9675a-f71d-4bdb-ac88-21cd549b5073 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:07.660180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3be9675a-f71d-4bdb-ac88-21cd549b5073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:07.726902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1260/2501] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:07.728582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974571-9a2f-45fc-af7e-5c286031e86d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.728937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974571-9a2f-45fc-af7e-5c286031e86d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.729281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974571-9a2f-45fc-af7e-5c286031e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.750972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d0974571-9a2f-45fc-af7e-5c286031e86d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:07.752188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d0974571-9a2f-45fc-af7e-5c286031e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:07.761233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1242/2502] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:07.765530 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9675a-f71d-4bdb-ac88-21cd549b5073 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:07.775649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9675a-f71d-4bdb-ac88-21cd549b5073 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:07.781051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:07.781698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.782008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.782306 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.783007 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:07.783312 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:07.785472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:07.787219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:07.806372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1261/2503] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:07.807766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974571-9a2f-45fc-af7e-5c286031e86d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:07.817812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974571-9a2f-45fc-af7e-5c286031e86d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:07.822596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:07.823213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.823493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.823767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.824425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:07.826343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:07.861592 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1243/2504] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:07 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:07.862851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:07.873159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcbfee-51b5-4ef0-a8ac-f6d5dd3af44f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:07.937848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:07.938526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.938807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.939082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.939763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:07.941915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:07.967340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1262/2505] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:07 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:07.972609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:07.984756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f228-b0c9-4486-816c-aa19943cfc8f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:07.989635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:07.990297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:07.990582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:07.991104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:07.991968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:07.993753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:08.010700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1244/2506] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:08.015278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:08.028457 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2091a6-18bb-4d0e-af04-4b7913a8afc3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:08.033564 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8fc22-1cfc-48b7-acb0-e378dba60f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:08.034476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8fc22-1cfc-48b7-acb0-e378dba60f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:08.035437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8fc22-1cfc-48b7-acb0-e378dba60f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:08.035781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8fc22-1cfc-48b7-acb0-e378dba60f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:08.036724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8fc22-1cfc-48b7-acb0-e378dba60f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:08.038636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8fc22-1cfc-48b7-acb0-e378dba60f41 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:08.057733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1263/2507] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:08.058935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:08.070871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e935-b6b2-43cc-9399-3b347db8fb5a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:08.076833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:08.077646 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:08.078064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:08.078540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] PATH_INFO: `/v3/projects/5b915f362b4f4783856978574102b742/users/d4704662554743d6b94f12c2340d17b9/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:08.095899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b915f362b4f4783856978574102b742, user_id=d4704662554743d6b94f12c2340d17b9, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:08.099667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:08.120837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1245/2508] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:08 2022] PUT /identity/v3/projects/5b915f362b4f4783856978574102b742/users/d4704662554743d6b94f12c2340d17b9/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:08.131219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367b88a-1a6e-4ce3-b37e-00cbf37ae1a9 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:08.131511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367b88a-1a6e-4ce3-b37e-00cbf37ae1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:08.132203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367b88a-1a6e-4ce3-b37e-00cbf37ae1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:08.161800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b367b88a-1a6e-4ce3-b37e-00cbf37ae1a9 None None] MFA Rules not processed for user `d4704662554743d6b94f12c2340d17b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:08.163065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b367b88a-1a6e-4ce3-b37e-00cbf37ae1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:08.241180 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1264/2509] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:08.247890 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:08.249751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:08.272212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:08.351715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3aa5-dd7d-438a-a4b3-5911d39c5641 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:08.358630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457399a5-d782-4134-8a69-73a69c806e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:08.359359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457399a5-d782-4134-8a69-73a69c806e45 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:08.359710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457399a5-d782-4134-8a69-73a69c806e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:08.360060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457399a5-d782-4134-8a69-73a69c806e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:08.371217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457399a5-d782-4134-8a69-73a69c806e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:08.373151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457399a5-d782-4134-8a69-73a69c806e45 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:08.393795 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1246/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:08.620368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367b88a-1a6e-4ce3-b37e-00cbf37ae1a9 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:08.683962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367b88a-1a6e-4ce3-b37e-00cbf37ae1a9 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:08.688667 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:08.689309 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:08.689588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:08.689861 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] PATH_INFO: `/v3/users/d4704662554743d6b94f12c2340d17b9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:08.691711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4704662554743d6b94f12c2340d17b9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:08.693661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:08.697634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:08.784205 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4704662554743d6b94f12c2340d17b9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:08.785582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4704662554743d6b94f12c2340d17b9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:08.795778 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4704662554743d6b94f12c2340d17b9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:08.806538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4704662554743d6b94f12c2340d17b9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:08.827119 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4704662554743d6b94f12c2340d17b9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:08.839499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1265/2511] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:08 2022] DELETE /identity/v3/users/d4704662554743d6b94f12c2340d17b9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:08.844063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:08.844866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:08.844866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:08.864735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:08.865950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:08.938565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1247/2512] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:08.949760 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:08.951841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:09.022850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7004-0c71-43b9-8978-004c391fe20f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.026933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.027557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.027832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.028102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.037710 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.039160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.048665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1266/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:09.357203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.358693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:09.372414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a2c31-5db6-426a-bcf1-0ede2d5cdbdc None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.398556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.399161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.399440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.400034 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] PATH_INFO: `/v3/projects/5b915f362b4f4783856978574102b742` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.407100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b915f362b4f4783856978574102b742)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.409048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.463713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.466554 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:09.473492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b915f362b4f4783856978574102b742', 'request_id': 'req-d81678a1-0c6e-4af1-bbad-311f818a9ccb'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.481494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b915f362b4f4783856978574102b742', 'request_id': 'req-d81678a1-0c6e-4af1-bbad-311f818a9ccb'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.488764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b915f362b4f4783856978574102b742', 'request_id': 'req-d81678a1-0c6e-4af1-bbad-311f818a9ccb'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.494680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31da2da-d226-4436-9656-76fe7a473f60 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.505745 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] The token cache is being invalidate because project 5b915f362b4f4783856978574102b742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:09.506028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.506879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d81678a1-0c6e-4af1-bbad-311f818a9ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.508346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1248/2514] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:09 2022] DELETE /identity/v3/projects/5b915f362b4f4783856978574102b742 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:09.513105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4af362-d703-47a6-85f0-3dea390d2b46 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.513533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4af362-d703-47a6-85f0-3dea390d2b46 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.513877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4af362-d703-47a6-85f0-3dea390d2b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.537541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-1e4af362-d703-47a6-85f0-3dea390d2b46 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:09.538803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1e4af362-d703-47a6-85f0-3dea390d2b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:09.556819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:09.567698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.568387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.568692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.568963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] PATH_INFO: `/v3/users/d5ad25c3f42e4ac2ad52592d55f94bb8` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.570158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ad25c3f42e4ac2ad52592d55f94bb8)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.572905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.600148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:09.606710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1249/2515] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:09.615737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d431-904c-4b97-be3f-9c71d49c62fb None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.616021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d431-904c-4b97-be3f-9c71d49c62fb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.616295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d431-904c-4b97-be3f-9c71d49c62fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.625455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ad25c3f42e4ac2ad52592d55f94bb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.626113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ad25c3f42e4ac2ad52592d55f94bb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.634648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ad25c3f42e4ac2ad52592d55f94bb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.636740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-6873d431-904c-4b97-be3f-9c71d49c62fb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:09.637967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6873d431-904c-4b97-be3f-9c71d49c62fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:09.641891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ad25c3f42e4ac2ad52592d55f94bb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.646380 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1250/2516] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:09.650475 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d431-904c-4b97-be3f-9c71d49c62fb None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.657839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ad25c3f42e4ac2ad52592d55f94bb8'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.660275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d431-904c-4b97-be3f-9c71d49c62fb None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.664764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1267/2517] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:09 2022] DELETE /identity/v3/users/d5ad25c3f42e4ac2ad52592d55f94bb8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:09.665071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.665751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.666097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.666492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.667187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:09.667520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.669148 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.682225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1251/2518] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:25:09.686458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.687972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:09.753721 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028e52c-7148-455f-8415-600361ddf4aa admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.758658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.759275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.759550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.759819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.760469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.762380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.790161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1268/2519] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:09 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:09.794364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.805083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1341a-2704-4ac5-9002-4c6703c42950 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.844139 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.846534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:09.865303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.865937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.866217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.866514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.867775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.870576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.893606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1252/2520] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:09 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:09.897914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.909842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9880f-d166-4f28-8f61-b57a8f6a8fcd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.914662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.915264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.915544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.915874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.916663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.917026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250b54e-a8cf-4556-838a-984c6108ba0b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.918275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.922104 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.922783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.923060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.923335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] PATH_INFO: `/v3/projects/b5b6a48bdf6a49319e4faf2a502b7586` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.924496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b6a48bdf6a49319e4faf2a502b7586)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.927012 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.929953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1253/2521] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:09.933796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.943760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37330d-4d60-4e74-a5c9-9dd990e85fbb admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.948424 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:09.949006 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:09.949283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:09.949552 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:09.950484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:09.952213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:09.962675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1254/2522] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:09.966583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:09.966791 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:09.977982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232149e-5bdf-451d-8af3-ea64e066d65f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:09.981850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b6a48bdf6a49319e4faf2a502b7586', 'request_id': 'req-c38762fd-4566-41e7-8e69-a18bb26e4a1a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.990177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b6a48bdf6a49319e4faf2a502b7586', 'request_id': 'req-c38762fd-4566-41e7-8e69-a18bb26e4a1a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:09.995953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b6a48bdf6a49319e4faf2a502b7586', 'request_id': 'req-c38762fd-4566-41e7-8e69-a18bb26e4a1a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:10.007528 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] The token cache is being invalidate because project b5b6a48bdf6a49319e4faf2a502b7586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:10.007818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:10.008466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c38762fd-4566-41e7-8e69-a18bb26e4a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:10.009982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1269/2523] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:09 2022] DELETE /identity/v3/projects/b5b6a48bdf6a49319e4faf2a502b7586 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:10.014824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5aed4-8aae-452b-8825-8fdc5080136d None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.015103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5aed4-8aae-452b-8825-8fdc5080136d None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.015370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5aed4-8aae-452b-8825-8fdc5080136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.036757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-4cd5aed4-8aae-452b-8825-8fdc5080136d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:10.037263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8f26-99ec-40df-ae5a-53d6987fc4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.037941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8f26-99ec-40df-ae5a-53d6987fc4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.038083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4cd5aed4-8aae-452b-8825-8fdc5080136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:10.038272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8f26-99ec-40df-ae5a-53d6987fc4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.038531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8f26-99ec-40df-ae5a-53d6987fc4c6 admin admin] PATH_INFO: `/v3/projects/74a8f7a0ab5d473790e08cc5fbf67865/users/2052486011964fd08e2e8bad1585d4a3/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.046226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1270/2524] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:10.054263 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb8f26-99ec-40df-ae5a-53d6987fc4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a8f7a0ab5d473790e08cc5fbf67865, user_id=2052486011964fd08e2e8bad1585d4a3, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.055006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610f4e-d1cc-411d-baa5-33a623200d22 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.055294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610f4e-d1cc-411d-baa5-33a623200d22 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.055568 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610f4e-d1cc-411d-baa5-33a623200d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.056921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb8f26-99ec-40df-ae5a-53d6987fc4c6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.059249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:10.070702 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1255/2525] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:09 2022] PUT /identity/v3/projects/74a8f7a0ab5d473790e08cc5fbf67865/users/2052486011964fd08e2e8bad1585d4a3/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:10.078399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-b4610f4e-d1cc-411d-baa5-33a623200d22 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:10.079613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-b4610f4e-d1cc-411d-baa5-33a623200d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:10.082660 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.082945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.083217 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.110975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] MFA Rules not processed for user `2052486011964fd08e2e8bad1585d4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:10.112186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:10.145452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1271/2526] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:10.149262 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610f4e-d1cc-411d-baa5-33a623200d22 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.157984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610f4e-d1cc-411d-baa5-33a623200d22 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.163200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.163798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.164077 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.164352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.165032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:10.165333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.166959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.177198 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1256/2527] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:10.181994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1272/2528] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:25:10.182910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.183162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.184249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:10.193208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311de5a-3a09-496f-aed9-6ac7575a2cc2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.197335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f7de4-6bbd-403a-b810-b58177b4223d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.200123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.200734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.201014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.201283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.201943 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.202132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.202718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.202995 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.203267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.203952 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.206054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.208503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.235943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1257/2529] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:10.239893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.244982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1273/2530] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:10.246015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.305004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a242c7-beae-4e48-a5a5-011c91c573eb admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.309606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.310320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.310460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746ca3-cd87-4442-9805-f212b2158d06 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.310596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.310865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.311550 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.313449 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.315226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.315868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.316145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.316443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.317093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.319048 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.335704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1258/2531] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:10.339732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.341065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1274/2532] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:10.344859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.350160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33b9f-8767-4f2b-b35b-4da5b8858999 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.354845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.355343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46405d82-8ba3-4e5e-80a7-7879431a4351 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.355450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.355720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.355991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.356684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.358317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.360086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.360681 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.360973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.361223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.361905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.363566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.364820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:10.368783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1259/2533] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:10.372986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.378358 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1275/2534] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:10.379909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.383457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ac049-49b3-4703-8a3e-e1906dd37b0c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.388141 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.388801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.389079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.389354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] PATH_INFO: `/v3/projects/aa4c70d002534e8483cad261db6ac055/users/13423f0c483a4b678a49201d23d57880/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.389806 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b72ba-9f28-4fd2-a1d6-ed517aa4ed36 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.395812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.396409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.396684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.396952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.397633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.399277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.404537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4c70d002534e8483cad261db6ac055, user_id=13423f0c483a4b678a49201d23d57880, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.407234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.413547 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1276/2535] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:10.414816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.421120 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1260/2536] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:10 2022] PUT /identity/v3/projects/aa4c70d002534e8483cad261db6ac055/users/13423f0c483a4b678a49201d23d57880/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:10.424954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.427308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d542415-3f46-40d5-a5c3-04e186404e1d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.448298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:10.487342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcb19f-2017-406c-abd2-cfbda31e99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.488051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb19f-2017-406c-abd2-cfbda31e99cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.488331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb19f-2017-406c-abd2-cfbda31e99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.488601 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb19f-2017-406c-abd2-cfbda31e99cb admin admin] PATH_INFO: `/v3/projects/bfe362db01504a8abc86a5e62fcf71dd/users/b975bcf9dc1b44639811e2cc3d08bac3/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.504290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0f8ff-1b9c-4609-a188-3deeb2948825 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.505469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb19f-2017-406c-abd2-cfbda31e99cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe362db01504a8abc86a5e62fcf71dd, user_id=b975bcf9dc1b44639811e2cc3d08bac3, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.508594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb19f-2017-406c-abd2-cfbda31e99cb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.509334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.509960 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.510257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.510551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.511245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.512841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.524257 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1261/2537] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:10.526518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1277/2538] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:10 2022] PUT /identity/v3/projects/bfe362db01504a8abc86a5e62fcf71dd/users/b975bcf9dc1b44639811e2cc3d08bac3/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:10.528204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.536720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299650f2-4448-4c10-a067-b7df2c3bad52 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.536988 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299650f2-4448-4c10-a067-b7df2c3bad52 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.537259 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299650f2-4448-4c10-a067-b7df2c3bad52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.539412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a55b9d-a73a-4f55-ac23-79f1ca2f9202 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.566070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-299650f2-4448-4c10-a067-b7df2c3bad52 None None] MFA Rules not processed for user `b975bcf9dc1b44639811e2cc3d08bac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:10.567303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-299650f2-4448-4c10-a067-b7df2c3bad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:10.602881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46c61d-5c88-4ce9-9319-ae3dd2d5fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.603559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46c61d-5c88-4ce9-9319-ae3dd2d5fb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.603840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46c61d-5c88-4ce9-9319-ae3dd2d5fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.604123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46c61d-5c88-4ce9-9319-ae3dd2d5fb65 admin admin] PATH_INFO: `/v3/projects/aa4c70d002534e8483cad261db6ac055/users/13423f0c483a4b678a49201d23d57880/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.606727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46c61d-5c88-4ce9-9319-ae3dd2d5fb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4c70d002534e8483cad261db6ac055, user_id=13423f0c483a4b678a49201d23d57880, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.609378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46c61d-5c88-4ce9-9319-ae3dd2d5fb65 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.620155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1262/2539] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:10 2022] PUT /identity/v3/projects/aa4c70d002534e8483cad261db6ac055/users/13423f0c483a4b678a49201d23d57880/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:10.630691 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9306-42ac-4f52-bd1c-e324fc39b4cf None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.630910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1278/2540] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:10.631150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9306-42ac-4f52-bd1c-e324fc39b4cf None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.631259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9306-42ac-4f52-bd1c-e324fc39b4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.635065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299650f2-4448-4c10-a067-b7df2c3bad52 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.646377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299650f2-4448-4c10-a067-b7df2c3bad52 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.658975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-264e9306-42ac-4f52-bd1c-e324fc39b4cf None None] MFA Rules not processed for user `13423f0c483a4b678a49201d23d57880`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:10.660747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-264e9306-42ac-4f52-bd1c-e324fc39b4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:10.697275 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:10.704333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.704871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.705642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.705958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.706868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.709468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.728896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1263/2541] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:10.736294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1279/2542] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:10.740780 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e9306-42ac-4f52-bd1c-e324fc39b4cf None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.741209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.742856 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:10.751310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e9306-42ac-4f52-bd1c-e324fc39b4cf None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.779692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:10.809584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.810200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.810508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.810833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.811507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.813588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.823411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed346c-a2db-497f-8603-734174421916 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.827452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.828068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.828403 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.828672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.834754 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1264/2543] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:10 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:10.838697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.848699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7a26-375a-4c65-a429-14a6ea979e85 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.853392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.853981 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.854297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.854576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.855265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.856852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.867129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1265/2544] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:10.871187 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.881278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642992f-3ebf-45ca-8ab9-c93de8e6f434 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:10.885925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:10.886596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:10.886879 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:10.887155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] PATH_INFO: `/v3/projects/d3966dd17cdc43ad87ebbc4c0b89e85e/users/daa449ad931343109be111edf875004c/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:10.890407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.891846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.902120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1280/2545] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:10.906047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3966dd17cdc43ad87ebbc4c0b89e85e, user_id=daa449ad931343109be111edf875004c, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:10.909975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:10.925023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1266/2546] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:10 2022] PUT /identity/v3/projects/d3966dd17cdc43ad87ebbc4c0b89e85e/users/daa449ad931343109be111edf875004c/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:10.929395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:10.940035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3b287-7097-4176-b24f-cab9e2a69122 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:11.002006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58930d-b765-4a4e-a3ef-32aff82d316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:11.002006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58930d-b765-4a4e-a3ef-32aff82d316c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.002006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58930d-b765-4a4e-a3ef-32aff82d316c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.002006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58930d-b765-4a4e-a3ef-32aff82d316c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.002433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58930d-b765-4a4e-a3ef-32aff82d316c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:11.003789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58930d-b765-4a4e-a3ef-32aff82d316c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:11.014969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1281/2547] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:11.019652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:11.030079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a2754-5a79-4ed2-a730-5566fcc6b0dd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:11.035375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:11.036144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.036490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.036872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] PATH_INFO: `/v3/projects/d3966dd17cdc43ad87ebbc4c0b89e85e/users/daa449ad931343109be111edf875004c/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.038925 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3966dd17cdc43ad87ebbc4c0b89e85e, user_id=daa449ad931343109be111edf875004c, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:11.041629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:11.052937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1267/2548] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:11 2022] PUT /identity/v3/projects/d3966dd17cdc43ad87ebbc4c0b89e85e/users/daa449ad931343109be111edf875004c/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:11.062952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb47ebe-f35d-47c8-a133-629b5acac581 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.063236 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb47ebe-f35d-47c8-a133-629b5acac581 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.063514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb47ebe-f35d-47c8-a133-629b5acac581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.090115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:11.106763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cdb47ebe-f35d-47c8-a133-629b5acac581 None None] MFA Rules not processed for user `daa449ad931343109be111edf875004c`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:11.109084 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cdb47ebe-f35d-47c8-a133-629b5acac581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:11.181202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1282/2549] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:11.193042 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:11.251365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b204a68-94d3-4be0-a066-71b1a1a6a55d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:11.255901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:11.256524 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.256804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.257077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.266573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:11.268038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:11.278398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1268/2550] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:11.327670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb47ebe-f35d-47c8-a133-629b5acac581 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:11.357445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:11.358948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:11.370406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0698848-e1c9-4b65-9eba-d19fde92fcca service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:11.374055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8823e3-8612-4b26-98be-1646023ec8e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:11.374692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8823e3-8612-4b26-98be-1646023ec8e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.374974 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8823e3-8612-4b26-98be-1646023ec8e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.375245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8823e3-8612-4b26-98be-1646023ec8e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.397848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb47ebe-f35d-47c8-a133-629b5acac581 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:11.402476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:11.403109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.403386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.403656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] PATH_INFO: `/v3/users/2052486011964fd08e2e8bad1585d4a3` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.404827 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2052486011964fd08e2e8bad1585d4a3)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:11.406769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:11.432913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8823e3-8612-4b26-98be-1646023ec8e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:11.434379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8823e3-8612-4b26-98be-1646023ec8e3 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:11.444205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1269/2551] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:11.458274 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2052486011964fd08e2e8bad1585d4a3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:11.458927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2052486011964fd08e2e8bad1585d4a3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:11.468409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2052486011964fd08e2e8bad1585d4a3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:11.476515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2052486011964fd08e2e8bad1585d4a3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:11.489416 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2052486011964fd08e2e8bad1585d4a3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:11.496832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1283/2552] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:11 2022] DELETE /identity/v3/users/2052486011964fd08e2e8bad1585d4a3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:11.501504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.501791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.502070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.523331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:11.524868 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:11.536416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:11.600763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1270/2553] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:11.610351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:11.611770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:11.630080 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:11.674210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1731-94cb-4228-85f3-f33dae28a878 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:11.678385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:11.678995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.679270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.679543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.688225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:11.689627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:11.699513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1284/2554] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:11.961381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:11.962927 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:11.975594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e823a4-59d5-476d-a123-5ff9ff65c6a1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:11.980320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:11.980983 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:11.981296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:11.981578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] PATH_INFO: `/v3/projects/74a8f7a0ab5d473790e08cc5fbf67865` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:11.983457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a8f7a0ab5d473790e08cc5fbf67865)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:11.985465 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:12.031297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a8f7a0ab5d473790e08cc5fbf67865', 'request_id': 'req-2aa755ed-3ff0-426e-a262-722a609401d3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.037787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a8f7a0ab5d473790e08cc5fbf67865', 'request_id': 'req-2aa755ed-3ff0-426e-a262-722a609401d3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.043325 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a8f7a0ab5d473790e08cc5fbf67865', 'request_id': 'req-2aa755ed-3ff0-426e-a262-722a609401d3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.055812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] The token cache is being invalidate because project 74a8f7a0ab5d473790e08cc5fbf67865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:12.056098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.056715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.058209 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1271/2555] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:11 2022] DELETE /identity/v3/projects/74a8f7a0ab5d473790e08cc5fbf67865 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:12.062216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:12.072052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4823e-bec1-4efa-bd8f-8dfdae04a9fa service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:12.128360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:12.128901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:12.129182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:12.129455 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] PATH_INFO: `/v3/users/13423f0c483a4b678a49201d23d57880` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:12.131078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13423f0c483a4b678a49201d23d57880)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:12.133062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:12.179159 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13423f0c483a4b678a49201d23d57880'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.179801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13423f0c483a4b678a49201d23d57880'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.186620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13423f0c483a4b678a49201d23d57880'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.193380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13423f0c483a4b678a49201d23d57880'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.205192 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e93e6796-68ce-43ee-b516-69dc6fdf634f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13423f0c483a4b678a49201d23d57880'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.211160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1285/2556] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:12 2022] DELETE /identity/v3/users/13423f0c483a4b678a49201d23d57880 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:12.483623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:12.485073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:12.499516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa755ed-3ff0-426e-a262-722a609401d3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:12.557083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:12.557729 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:12.558012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:12.558326 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] PATH_INFO: `/v3/projects/aa4c70d002534e8483cad261db6ac055` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:12.559501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4c70d002534e8483cad261db6ac055)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:12.561425 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:12.601493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:12.611507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4c70d002534e8483cad261db6ac055', 'request_id': 'req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.618158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4c70d002534e8483cad261db6ac055', 'request_id': 'req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.628036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4c70d002534e8483cad261db6ac055', 'request_id': 'req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.640846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] The token cache is being invalidate because project aa4c70d002534e8483cad261db6ac055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:12.641311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.641975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-63b96d49-41e6-4ccc-9ad7-8188ebe0407b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:12.643584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1272/2557] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:12 2022] DELETE /identity/v3/projects/aa4c70d002534e8483cad261db6ac055 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:12.648933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407fa61-61e4-4eee-844c-73370ffecff7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:12.649401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407fa61-61e4-4eee-844c-73370ffecff7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:12.649497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407fa61-61e4-4eee-844c-73370ffecff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:12.671210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-c407fa61-61e4-4eee-844c-73370ffecff7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:12.672399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-c407fa61-61e4-4eee-844c-73370ffecff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:12.704345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:12.735429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1286/2558] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:12.743606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18c152-8abd-4401-aeed-fb0b8b968d7e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:12.743870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18c152-8abd-4401-aeed-fb0b8b968d7e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:12.744143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18c152-8abd-4401-aeed-fb0b8b968d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:12.764338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-3b18c152-8abd-4401-aeed-fb0b8b968d7e None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:12.765604 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3b18c152-8abd-4401-aeed-fb0b8b968d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:12.776971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1273/2559] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:12.783001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407fa61-61e4-4eee-844c-73370ffecff7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:12.794176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407fa61-61e4-4eee-844c-73370ffecff7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:12.800653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:12.801354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:12.801689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:12.801964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:12.802769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:12.803073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:12.804771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:12.818189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1287/2560] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:12.823152 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18c152-8abd-4401-aeed-fb0b8b968d7e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:12.833235 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18c152-8abd-4401-aeed-fb0b8b968d7e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:12.838012 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:12.838653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:12.838933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:12.839204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:12.839870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:12.841772 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:12.870692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1274/2561] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:12 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:12.875857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:12.888639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fbbae-66cd-440c-a58a-1d1c4a7ae908 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:12.964688 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:12.965414 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:12.965879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:12.966356 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:12.967092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:12.969411 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.003817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1288/2562] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:12 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:13.009992 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.021061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b196f-48c6-4bd9-a02f-4057d77d3d33 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.026025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.026682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.026979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.027245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.027973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.029621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.039976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1275/2563] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:13.043939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.054186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09994cd-a5bd-43c3-b86b-f4af89326d9c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.058804 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5583c-2d4e-4e1c-a255-c935dea0d4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.059432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5583c-2d4e-4e1c-a255-c935dea0d4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.059685 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5583c-2d4e-4e1c-a255-c935dea0d4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.059955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5583c-2d4e-4e1c-a255-c935dea0d4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.060644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5583c-2d4e-4e1c-a255-c935dea0d4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.062212 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5583c-2d4e-4e1c-a255-c935dea0d4c5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.073540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1289/2564] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:13.077759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.087860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b588c0a-2a89-4b56-928f-3fb7561fba28 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.092511 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.093164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.093444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.093713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] PATH_INFO: `/v3/projects/41e1abfeb5a3440f928817892357a8a9/users/73bd618c666842d384d94341ddebb5e1/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.108027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e1abfeb5a3440f928817892357a8a9, user_id=73bd618c666842d384d94341ddebb5e1, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.110720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.124378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1276/2565] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:13 2022] PUT /identity/v3/projects/41e1abfeb5a3440f928817892357a8a9/users/73bd618c666842d384d94341ddebb5e1/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:13.135333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c402fb-2c54-436c-99bd-f42f7c6a296f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.135610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c402fb-2c54-436c-99bd-f42f7c6a296f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.135879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c402fb-2c54-436c-99bd-f42f7c6a296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.163395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d7c402fb-2c54-436c-99bd-f42f7c6a296f None None] MFA Rules not processed for user `73bd618c666842d384d94341ddebb5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:13.164519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d7c402fb-2c54-436c-99bd-f42f7c6a296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:13.229364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1290/2566] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:13.233869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.294483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1df13-551a-473f-b61d-bbb416bbc92d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.299113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.299724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.300504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.300775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.301418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.303366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.329317 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1277/2567] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:13 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:13.333452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c402fb-2c54-436c-99bd-f42f7c6a296f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.344109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c402fb-2c54-436c-99bd-f42f7c6a296f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.372662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:13.406660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.407278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.407559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.407835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.408503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.410996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.432100 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1291/2568] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:13 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:13.436065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.447520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0b928-31b8-4bd9-ac36-9d1e5a1793db admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.452214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.452829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.453111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.453399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.454086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.456101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.469771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1278/2569] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:13.474427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.484429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bbf0b-38c1-4adb-8cef-ab463c9f3190 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.489585 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.490287 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.490563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.490829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] PATH_INFO: `/v3/projects/6bf3143e31464388bc0ba7aec66416db/users/8357ce32669b4dcabfc2d27942b920f7/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.505708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf3143e31464388bc0ba7aec66416db, user_id=8357ce32669b4dcabfc2d27942b920f7, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.508738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.521712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1292/2570] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:13 2022] PUT /identity/v3/projects/6bf3143e31464388bc0ba7aec66416db/users/8357ce32669b4dcabfc2d27942b920f7/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:13.525675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.536249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487188-081d-429a-96b6-b1d8fb35c4d7 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.571094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:13.596443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246e83-5f3e-41b6-a0cc-592bb1cdd83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.597586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246e83-5f3e-41b6-a0cc-592bb1cdd83f admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.597869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246e83-5f3e-41b6-a0cc-592bb1cdd83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.598143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246e83-5f3e-41b6-a0cc-592bb1cdd83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.598867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246e83-5f3e-41b6-a0cc-592bb1cdd83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.600462 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246e83-5f3e-41b6-a0cc-592bb1cdd83f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.610605 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1279/2571] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:13.614853 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.625397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b8c6f-54b0-48f5-bab0-0f262261364e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.630056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.630999 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.631281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.631556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] PATH_INFO: `/v3/projects/6bf3143e31464388bc0ba7aec66416db/users/8357ce32669b4dcabfc2d27942b920f7/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.633559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf3143e31464388bc0ba7aec66416db, user_id=8357ce32669b4dcabfc2d27942b920f7, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.636204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.646319 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1293/2572] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:13 2022] PUT /identity/v3/projects/6bf3143e31464388bc0ba7aec66416db/users/8357ce32669b4dcabfc2d27942b920f7/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:13.656497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.656787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.657065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.685186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] MFA Rules not processed for user `8357ce32669b4dcabfc2d27942b920f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:13.686365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:13.754419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1280/2573] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:13.765736 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:13.767595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:13.823594 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228aa6c-11ea-4111-9a24-a90d03f3f0da admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:13.827220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:13.827818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:13.828097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:13.828364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:13.881825 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:13.883269 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:13.891844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1294/2574] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:16.467200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:16.468575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:16.480853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfceac-f7a4-4ee7-be22-cc2169094823 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:16.484533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b89a3-fa9f-4927-881a-3b6e4559a9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:16.485170 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b89a3-fa9f-4927-881a-3b6e4559a9dd service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:16.485448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b89a3-fa9f-4927-881a-3b6e4559a9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:16.485719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b89a3-fa9f-4927-881a-3b6e4559a9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:16.495514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b89a3-fa9f-4927-881a-3b6e4559a9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:16.496970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b89a3-fa9f-4927-881a-3b6e4559a9dd service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:16.506621 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1281/2575] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:23.887984 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:26.502099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=52 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:29.059299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:29.127707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8246f8-39cf-46cf-8376-0664d6785a08 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:29.132798 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:29.133491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:29.133769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:29.134037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] PATH_INFO: `/v3/users/73bd618c666842d384d94341ddebb5e1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:29.135281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bd618c666842d384d94341ddebb5e1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:29.137225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:29.184103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bd618c666842d384d94341ddebb5e1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.184230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bd618c666842d384d94341ddebb5e1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.191701 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bd618c666842d384d94341ddebb5e1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.199340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bd618c666842d384d94341ddebb5e1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.210874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bd618c666842d384d94341ddebb5e1'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.216671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1295/2576] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:29 2022] DELETE /identity/v3/users/73bd618c666842d384d94341ddebb5e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:29.221068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:29.221514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:29.221655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:29.240820 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:29.242664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:29.299631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1282/2577] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:29.310596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:29.312050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:29.370372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642eadc-4f01-49a8-8e45-fd2093c5ffa4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:29.374013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:29.374664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:29.374945 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:29.375218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:29.384461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:29.385886 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:29.399651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1296/2578] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:29.677101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:29.678650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:29.691842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ff117-ca50-4076-a112-fe09aaeb01df None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:29.696941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:29.697676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:29.698027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:29.698397 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] PATH_INFO: `/v3/projects/41e1abfeb5a3440f928817892357a8a9` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:29.699644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e1abfeb5a3440f928817892357a8a9)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:29.701793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:29.755296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e1abfeb5a3440f928817892357a8a9', 'request_id': 'req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.761893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e1abfeb5a3440f928817892357a8a9', 'request_id': 'req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.768203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e1abfeb5a3440f928817892357a8a9', 'request_id': 'req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.781900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] The token cache is being invalidate because project 41e1abfeb5a3440f928817892357a8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:29.782189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.782845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.784322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1283/2579] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:29 2022] DELETE /identity/v3/projects/41e1abfeb5a3440f928817892357a8a9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:29.788209 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:29.798256 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc813b-f089-425d-ba25-4c0ef75da0b2 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:29.818177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:29.872441 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:29.873087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:29.873371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:29.873646 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] PATH_INFO: `/v3/users/8357ce32669b4dcabfc2d27942b920f7` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:29.874962 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8357ce32669b4dcabfc2d27942b920f7)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:29.877862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:29.936941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8357ce32669b4dcabfc2d27942b920f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.937590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8357ce32669b4dcabfc2d27942b920f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.945882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8357ce32669b4dcabfc2d27942b920f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.953501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8357ce32669b4dcabfc2d27942b920f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.972914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8357ce32669b4dcabfc2d27942b920f7'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:29.982118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1297/2580] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:29 2022] DELETE /identity/v3/users/8357ce32669b4dcabfc2d27942b920f7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:30.094920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.096561 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:30.169601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc611f70-e5b3-4c2b-ba5a-1781ff2e9ce2 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.210683 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:30.223356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091d28-ad56-4293-8f28-c73e0127b3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.224031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091d28-ad56-4293-8f28-c73e0127b3ab service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.224576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091d28-ad56-4293-8f28-c73e0127b3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.224887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091d28-ad56-4293-8f28-c73e0127b3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.226689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1a091d28-ad56-4293-8f28-c73e0127b3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:30.283573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.285071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:30.302718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a091d28-ad56-4293-8f28-c73e0127b3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.304166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a091d28-ad56-4293-8f28-c73e0127b3ab service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.314775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1284/2581] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:30.365255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800439bf-caf6-4d9b-b8ad-5b4efc3d0a32 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.370178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.370854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.371132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.371402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] PATH_INFO: `/v3/projects/6bf3143e31464388bc0ba7aec66416db` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.372565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf3143e31464388bc0ba7aec66416db)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.374523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.420486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:30.425219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf3143e31464388bc0ba7aec66416db', 'request_id': 'req-478ce47d-0c56-41cc-850e-d40fc8a46535'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:30.434880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf3143e31464388bc0ba7aec66416db', 'request_id': 'req-478ce47d-0c56-41cc-850e-d40fc8a46535'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:30.442251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf3143e31464388bc0ba7aec66416db', 'request_id': 'req-478ce47d-0c56-41cc-850e-d40fc8a46535'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:30.454193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] The token cache is being invalidate because project 6bf3143e31464388bc0ba7aec66416db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:30.454514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:30.455167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-478ce47d-0c56-41cc-850e-d40fc8a46535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:30.456687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1298/2582] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:30 2022] DELETE /identity/v3/projects/6bf3143e31464388bc0ba7aec66416db => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:30.462040 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a1d4-9d25-4803-b597-f801ce6341de None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.462352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a1d4-9d25-4803-b597-f801ce6341de None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.462713 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a1d4-9d25-4803-b597-f801ce6341de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.483048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9f92a1d4-9d25-4803-b597-f801ce6341de None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:30.484260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9f92a1d4-9d25-4803-b597-f801ce6341de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:30.543507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1285/2583] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:30.552978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f0fc3-de27-40eb-b94b-c229853121eb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.553378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f0fc3-de27-40eb-b94b-c229853121eb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.553724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f0fc3-de27-40eb-b94b-c229853121eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.574698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a26f0fc3-de27-40eb-b94b-c229853121eb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:30.576036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a26f0fc3-de27-40eb-b94b-c229853121eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:30.584231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1299/2584] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:30.589154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92a1d4-9d25-4803-b597-f801ce6341de None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.598897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92a1d4-9d25-4803-b597-f801ce6341de None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.603682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.604301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.604581 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.604854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.605580 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:30.605883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.607543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.619514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1286/2585] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:30.623844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f0fc3-de27-40eb-b94b-c229853121eb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.634051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f0fc3-de27-40eb-b94b-c229853121eb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.638539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.639147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.639422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.639692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.640353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.642268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.670051 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1300/2586] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:30 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:30.674155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.684199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f4d3b-2337-49ec-acfc-dae8f7a1f6ac admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.746243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.746888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.747164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.747448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.748796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.750137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.775598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1287/2587] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:30 2022] POST /identity/v3/users => generated 280 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:30.776880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.787325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eff68-fa1a-4046-ba93-175048e3499e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.792026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.792639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.792968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.793198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.793870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.795662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.806882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1301/2588] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:30.811915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.822985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc986e8-3ef6-40cd-96f3-9cffca58d657 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.827700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12941d8-58df-4073-b7a3-87760e9bb8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.828310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12941d8-58df-4073-b7a3-87760e9bb8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.828584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12941d8-58df-4073-b7a3-87760e9bb8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.828848 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12941d8-58df-4073-b7a3-87760e9bb8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.829534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12941d8-58df-4073-b7a3-87760e9bb8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.831149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12941d8-58df-4073-b7a3-87760e9bb8cb admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.832498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:30.845357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1288/2589] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:30.849136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:30.859298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61287b87-7d66-486b-804f-a6a995bd6ec7 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:30.863983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:30.864643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.864958 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.865237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] PATH_INFO: `/v3/projects/61c93408aa0d40ef93dc8d32254387bf/users/dd39f05927914eecba503635dace4974/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.880340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c93408aa0d40ef93dc8d32254387bf, user_id=dd39f05927914eecba503635dace4974, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:30.884011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:30.899214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1302/2590] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:30 2022] PUT /identity/v3/projects/61c93408aa0d40ef93dc8d32254387bf/users/dd39f05927914eecba503635dace4974/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:30.909841 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915575c-a2dd-49df-983a-e2d6bf23347b None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:30.910137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915575c-a2dd-49df-983a-e2d6bf23347b None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:30.910455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915575c-a2dd-49df-983a-e2d6bf23347b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:30.939293 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-6915575c-a2dd-49df-983a-e2d6bf23347b None None] MFA Rules not processed for user `dd39f05927914eecba503635dace4974`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:30.940591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6915575c-a2dd-49df-983a-e2d6bf23347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:31.008638 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1289/2591] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:31.041714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:31.043450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:31.113315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d7242-f4e3-407e-97c7-43d5986350c4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:31.118341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b378a-60dc-4e28-9f7f-9e9839b81302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:31.119565 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b378a-60dc-4e28-9f7f-9e9839b81302 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:31.120024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b378a-60dc-4e28-9f7f-9e9839b81302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:31.120529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b378a-60dc-4e28-9f7f-9e9839b81302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:31.132167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b378a-60dc-4e28-9f7f-9e9839b81302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:31.139549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b378a-60dc-4e28-9f7f-9e9839b81302 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:31.150449 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1303/2592] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:31 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:31.161742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915575c-a2dd-49df-983a-e2d6bf23347b None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:31.244470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915575c-a2dd-49df-983a-e2d6bf23347b None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:31.249661 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:31.250368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:31.250652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:31.250930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] PATH_INFO: `/v3/users/dd39f05927914eecba503635dace4974` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:31.252142 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd39f05927914eecba503635dace4974)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:31.254518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:31.354719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd39f05927914eecba503635dace4974'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:31.356379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd39f05927914eecba503635dace4974'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:31.364871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd39f05927914eecba503635dace4974'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:31.365593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd39f05927914eecba503635dace4974'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:31.387675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd39f05927914eecba503635dace4974'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:31.404203 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1290/2593] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:31 2022] DELETE /identity/v3/users/dd39f05927914eecba503635dace4974 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:31.409258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:31.409786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:31.410113 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:31.432310 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:31.433511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:31.512562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1304/2594] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:31.524783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:31.526223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:31.533174 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:31.586807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cac783-fd61-4c4c-b6ff-ad1e95dc8ea1 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:31.590453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5fa12-9f26-4aa3-b0eb-0b936901384d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:31.591072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5fa12-9f26-4aa3-b0eb-0b936901384d service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:31.591352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5fa12-9f26-4aa3-b0eb-0b936901384d service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:31.591623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5fa12-9f26-4aa3-b0eb-0b936901384d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:31.601010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5fa12-9f26-4aa3-b0eb-0b936901384d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:31.603062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5fa12-9f26-4aa3-b0eb-0b936901384d service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:31.613624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1291/2595] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:32.235401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:32.236770 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:32.253869 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08900c97-93b7-4dd8-9e37-1acc73dfdb7a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:32.260910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:32.261427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.261707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.262148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] PATH_INFO: `/v3/projects/61c93408aa0d40ef93dc8d32254387bf` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.263849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c93408aa0d40ef93dc8d32254387bf)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:32.266101 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:32.274442 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:32.345462 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c93408aa0d40ef93dc8d32254387bf', 'request_id': 'req-63933a3b-7ce1-4c7a-82de-6d212d317048'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:32.355852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c93408aa0d40ef93dc8d32254387bf', 'request_id': 'req-63933a3b-7ce1-4c7a-82de-6d212d317048'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:32.366906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c93408aa0d40ef93dc8d32254387bf', 'request_id': 'req-63933a3b-7ce1-4c7a-82de-6d212d317048'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:32.383278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] The token cache is being invalidate because project 61c93408aa0d40ef93dc8d32254387bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:32.383863 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:32.384717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-63933a3b-7ce1-4c7a-82de-6d212d317048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:32.391534 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1305/2596] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:32 2022] DELETE /identity/v3/projects/61c93408aa0d40ef93dc8d32254387bf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:32.394359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13139a50-c7c4-48d6-ab17-2bcc2d032d6a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.394359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13139a50-c7c4-48d6-ab17-2bcc2d032d6a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.394912 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13139a50-c7c4-48d6-ab17-2bcc2d032d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.420241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-13139a50-c7c4-48d6-ab17-2bcc2d032d6a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:32.421682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-13139a50-c7c4-48d6-ab17-2bcc2d032d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:32.544832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1292/2597] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:32.552855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57cd0-6796-4850-892b-36cfe1285185 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.553347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57cd0-6796-4850-892b-36cfe1285185 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.553518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57cd0-6796-4850-892b-36cfe1285185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.585276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d5e57cd0-6796-4850-892b-36cfe1285185 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:32.587208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d5e57cd0-6796-4850-892b-36cfe1285185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:32.597471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1306/2598] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:32.601339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13139a50-c7c4-48d6-ab17-2bcc2d032d6a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:32.612305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13139a50-c7c4-48d6-ab17-2bcc2d032d6a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:32.619497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:32.620200 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.620740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.621082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.623029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:32.623419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:32.625787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:32.640014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1293/2599] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:32.646505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e57cd0-6796-4850-892b-36cfe1285185 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:32.663832 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e57cd0-6796-4850-892b-36cfe1285185 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:32.671748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:32.672536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.672822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.673092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.673765 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:32.675717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:32.712563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1307/2600] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:32 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:32.716753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:32.727248 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2099c-b747-42b9-9646-22b6648744ea admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:32.793055 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:32.793681 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.793959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.794249 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.794926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:32.796836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:32.822075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1294/2601] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:32 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:32.826020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:32.840235 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0477-8961-4214-a2d6-767447b53113 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:32.845167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:32.846372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.846750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.847121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.848168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:32.850429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:32.862584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1308/2602] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:32.867563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:32.879215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15feb8-5321-480f-9bce-95c3c8dc00f0 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:32.885058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def46929-76f4-4665-b563-f9ce3c0f8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:32.885708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46929-76f4-4665-b563-f9ce3c0f8bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.885993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46929-76f4-4665-b563-f9ce3c0f8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.886366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46929-76f4-4665-b563-f9ce3c0f8bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.887077 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def46929-76f4-4665-b563-f9ce3c0f8bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:32.888703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def46929-76f4-4665-b563-f9ce3c0f8bf8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:32.900390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1295/2603] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:32.907513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:32.925988 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d12815-1a16-4a6b-a4d4-b17c0e207901 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:32.932297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:32.933021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.933266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.933542 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] PATH_INFO: `/v3/projects/501eb37ddca14e4986ff53ef54405906/users/5d3524ee350f4f7c8f581f73272c0cd2/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:32.951064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] RBAC: Authorizing `identity:create_grant(project_id=501eb37ddca14e4986ff53ef54405906, user_id=5d3524ee350f4f7c8f581f73272c0cd2, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:32.953895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:32.973752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1309/2604] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:32 2022] PUT /identity/v3/projects/501eb37ddca14e4986ff53ef54405906/users/5d3524ee350f4f7c8f581f73272c0cd2/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:32.984451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:32.984743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:32.985021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:33.016214 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:33.020571 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] MFA Rules not processed for user `5d3524ee350f4f7c8f581f73272c0cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:33.024018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:33.108459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1296/2605] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:33.120844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:33.123011 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:33.207185 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212bd9c-6360-4704-bc70-f8026e84000e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:33.211473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:33.212239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:33.212524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:33.212811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:33.222020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:33.223580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:33.234852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1310/2606] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:33.908767 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:33.910746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:33.976734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ec83-5663-4bb6-8044-402325cf676c None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:33.981309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:33.981954 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:33.982254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:33.982563 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] PATH_INFO: `/v3/users/c3b5516b045444cc959043157a4367ea` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:33.983738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b5516b045444cc959043157a4367ea)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:33.985779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:34.037492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b5516b045444cc959043157a4367ea'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.038211 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b5516b045444cc959043157a4367ea'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.047247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b5516b045444cc959043157a4367ea'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.047904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b5516b045444cc959043157a4367ea'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.062917 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cc5f7f28-a2c7-4cc6-a876-77fa68fcc773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b5516b045444cc959043157a4367ea'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.081109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1297/2607] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:33 2022] DELETE /identity/v3/users/c3b5516b045444cc959043157a4367ea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:34.279470 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:34.294488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cbc71-ee3c-4295-90cd-9be528278195 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:34.454860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:34.483913 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:34.484550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.484827 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.485098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] PATH_INFO: `/v3/projects/0f0f84d89789430f8ed24e07ce5dcae9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.486255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0f84d89789430f8ed24e07ce5dcae9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:34.488134 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:34.534725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0f84d89789430f8ed24e07ce5dcae9', 'request_id': 'req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.543145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0f84d89789430f8ed24e07ce5dcae9', 'request_id': 'req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.548661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0f84d89789430f8ed24e07ce5dcae9', 'request_id': 'req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.560367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] The token cache is being invalidate because project 0f0f84d89789430f8ed24e07ce5dcae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:34.560651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.561283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-bd3d9ac0-6770-4308-b9db-a9abcd7ea5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:34.562998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1311/2608] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:34 2022] DELETE /identity/v3/projects/0f0f84d89789430f8ed24e07ce5dcae9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:34.567926 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f26911-593a-491a-86ba-87e9503bb8c4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.568273 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f26911-593a-491a-86ba-87e9503bb8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.568532 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f26911-593a-491a-86ba-87e9503bb8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.588125 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-83f26911-593a-491a-86ba-87e9503bb8c4 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:34.589394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-83f26911-593a-491a-86ba-87e9503bb8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:34.606900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:34.649852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1298/2609] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:34.658293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71378fe-f9a9-4373-87dc-07c54b57a242 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.658683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71378fe-f9a9-4373-87dc-07c54b57a242 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.659035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71378fe-f9a9-4373-87dc-07c54b57a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.678951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f71378fe-f9a9-4373-87dc-07c54b57a242 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:34.680714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f71378fe-f9a9-4373-87dc-07c54b57a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:34.688566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1312/2610] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:34.692763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f26911-593a-491a-86ba-87e9503bb8c4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:34.702902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f26911-593a-491a-86ba-87e9503bb8c4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:34.707663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:34.708352 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.708695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.708970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.709668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:34.709969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:34.712150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:34.724017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1299/2611] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:34.729150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71378fe-f9a9-4373-87dc-07c54b57a242 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:34.738398 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71378fe-f9a9-4373-87dc-07c54b57a242 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:34.743072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:34.743671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.743948 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.744214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.744860 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:34.746850 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:34.777340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1313/2612] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:34 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:34.781579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:34.792906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1917fb-9b96-4611-9dc6-aeaf185a4d78 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:34.865493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:34.865493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.865493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.865493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.865872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:34.865872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:34.887864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1300/2613] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:34 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:34.892065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:34.902830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b1286-8bdf-4b43-bb3b-b4fafb6a1aaf admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:34.909556 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:34.910327 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.910635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.910942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.911678 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:34.913297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:34.923902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1314/2614] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:34.927873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:34.937797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecb1d3-e2b8-43c4-8a41-6283a7f06877 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:34.942487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9af417-d5da-4a79-b7c1-b61437d0a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:34.943036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af417-d5da-4a79-b7c1-b61437d0a88a admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.943321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af417-d5da-4a79-b7c1-b61437d0a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.943595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af417-d5da-4a79-b7c1-b61437d0a88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.944289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9af417-d5da-4a79-b7c1-b61437d0a88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:34.945875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9af417-d5da-4a79-b7c1-b61437d0a88a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:34.956398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1301/2615] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:34.960406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:34.970609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d303-5a21-47f4-9c5b-f090ad07779a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:34.975120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:34.975787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:34.976060 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:34.976956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] PATH_INFO: `/v3/projects/bca744c9022d459abb1a451d87868bf6/users/a1b1c564bb354d0e850dbbdf243b7a8d/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:34.991276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca744c9022d459abb1a451d87868bf6, user_id=a1b1c564bb354d0e850dbbdf243b7a8d, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:34.993989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.006756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1315/2616] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:34 2022] PUT /identity/v3/projects/bca744c9022d459abb1a451d87868bf6/users/a1b1c564bb354d0e850dbbdf243b7a8d/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:35.016955 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fcf71-77d5-4e96-9e97-d43c169b0fae None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.017244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fcf71-77d5-4e96-9e97-d43c169b0fae None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.017558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fcf71-77d5-4e96-9e97-d43c169b0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.051388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-016fcf71-77d5-4e96-9e97-d43c169b0fae None None] MFA Rules not processed for user `a1b1c564bb354d0e850dbbdf243b7a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:35.052630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-016fcf71-77d5-4e96-9e97-d43c169b0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:35.115842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1302/2617] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:35.120325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.180724 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd8c0-d643-46e4-968a-1d1856efe58c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.185343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.185946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.186225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.186527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.187186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.189053 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.193451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:35.218682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1316/2618] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:35 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:35.223131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fcf71-77d5-4e96-9e97-d43c169b0fae None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.234060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fcf71-77d5-4e96-9e97-d43c169b0fae None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.246727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:35.299357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.300134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.300443 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.300720 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.301451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.303460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.328166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1303/2619] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:35 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:35.329855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.340764 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d540-d532-42bb-a193-44359da8efee admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.345816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.346469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.346748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.347020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.347786 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.349361 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.359927 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1317/2620] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:35.364137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.374712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895b7a-dbd9-49a6-93d4-4ba662461e16 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.383168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.384329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.384831 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.385331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] PATH_INFO: `/v3/projects/f533686e15354110961a86542d8d1006/users/21bf785b9d674741a53ea727f5370fc1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.402463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f533686e15354110961a86542d8d1006, user_id=21bf785b9d674741a53ea727f5370fc1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.405243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.419133 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1304/2621] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:35 2022] PUT /identity/v3/projects/f533686e15354110961a86542d8d1006/users/21bf785b9d674741a53ea727f5370fc1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:35.423196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.433609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28948de-57fd-4b2a-839c-efedb902d72d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.492521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7db96-d65a-40dd-91a2-ec03cdf9f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.493131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7db96-d65a-40dd-91a2-ec03cdf9f802 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.493408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7db96-d65a-40dd-91a2-ec03cdf9f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.493683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7db96-d65a-40dd-91a2-ec03cdf9f802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.494397 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7db96-d65a-40dd-91a2-ec03cdf9f802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.495981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7db96-d65a-40dd-91a2-ec03cdf9f802 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.505859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1318/2622] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:35.510978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.521343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea0178-8746-40e5-9c2b-f98a1a9f52c2 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.526208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.527003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.527280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.527595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] PATH_INFO: `/v3/projects/f533686e15354110961a86542d8d1006/users/21bf785b9d674741a53ea727f5370fc1/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.529636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f533686e15354110961a86542d8d1006, user_id=21bf785b9d674741a53ea727f5370fc1, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.532296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.543777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1305/2623] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:35 2022] PUT /identity/v3/projects/f533686e15354110961a86542d8d1006/users/21bf785b9d674741a53ea727f5370fc1/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:35.556016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeda1d-b26c-429c-8a56-632495f76b4f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.556304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeda1d-b26c-429c-8a56-632495f76b4f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.556578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeda1d-b26c-429c-8a56-632495f76b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.591323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a0aeda1d-b26c-429c-8a56-632495f76b4f None None] MFA Rules not processed for user `21bf785b9d674741a53ea727f5370fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:35.592527 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a0aeda1d-b26c-429c-8a56-632495f76b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:35.686206 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1319/2624] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:35.695614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.696887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:35.754515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ad5ec-f477-461c-b03f-8667f6488925 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.759107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.759723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.759993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.760264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.769038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.770480 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.779643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1306/2625] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:35.853351 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeda1d-b26c-429c-8a56-632495f76b4f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:35.863128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeda1d-b26c-429c-8a56-632495f76b4f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:35.866807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e63e5b-4e26-44a6-b059-3afc5e10b045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:35.867965 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e63e5b-4e26-44a6-b059-3afc5e10b045 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:35.868240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e63e5b-4e26-44a6-b059-3afc5e10b045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:35.868756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e63e5b-4e26-44a6-b059-3afc5e10b045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:35.928024 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:35.933296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e63e5b-4e26-44a6-b059-3afc5e10b045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:35.935204 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e63e5b-4e26-44a6-b059-3afc5e10b045 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:35.946464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1320/2626] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:41.019921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:41.021381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:41.084706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff330-4671-435b-830e-cde52c336887 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:41.090038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:41.090707 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:41.091010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:41.091283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] PATH_INFO: `/v3/users/b975bcf9dc1b44639811e2cc3d08bac3` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:41.092495 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b975bcf9dc1b44639811e2cc3d08bac3)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:41.094467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:41.108096 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:41.141959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b975bcf9dc1b44639811e2cc3d08bac3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.142618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b975bcf9dc1b44639811e2cc3d08bac3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.150056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b975bcf9dc1b44639811e2cc3d08bac3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.150753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b975bcf9dc1b44639811e2cc3d08bac3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.162853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b975bcf9dc1b44639811e2cc3d08bac3'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.175448 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1307/2627] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:41 2022] DELETE /identity/v3/users/b975bcf9dc1b44639811e2cc3d08bac3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:41.179895 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:41.180360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:41.180463 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:41.199196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:41.200378 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:41.259675 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1321/2628] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:41.269287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:41.270721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:41.328590 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4664f3-c03c-4d1a-bf78-b3f92512f9a5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:41.332230 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:41.332941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:41.333225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:41.333494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:41.343302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:41.344735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:41.354169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1308/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:41.624406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:41.626207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:41.644631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb82887-6ffd-49da-822b-ddafc3d6a7a6 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:41.663576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:41.664248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:41.666183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:41.666539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] PATH_INFO: `/v3/projects/bfe362db01504a8abc86a5e62fcf71dd` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:41.667772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe362db01504a8abc86a5e62fcf71dd)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:41.670773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:41.720377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe362db01504a8abc86a5e62fcf71dd', 'request_id': 'req-e9dfb1d6-a662-4c44-8db1-9a54063067bf'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.727785 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe362db01504a8abc86a5e62fcf71dd', 'request_id': 'req-e9dfb1d6-a662-4c44-8db1-9a54063067bf'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.733567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe362db01504a8abc86a5e62fcf71dd', 'request_id': 'req-e9dfb1d6-a662-4c44-8db1-9a54063067bf'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.745050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] The token cache is being invalidate because project bfe362db01504a8abc86a5e62fcf71dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:41.745336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.746037 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.748105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1322/2630] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:41 2022] DELETE /identity/v3/projects/bfe362db01504a8abc86a5e62fcf71dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:41.752218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:41.763182 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e0c7-e5ec-4739-a864-5a37654e7837 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:41.823066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:41.823717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:41.823999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:41.824275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] PATH_INFO: `/v3/users/daa449ad931343109be111edf875004c` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:41.825450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa449ad931343109be111edf875004c)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:41.827393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:41.869588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:41.880625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa449ad931343109be111edf875004c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.881531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa449ad931343109be111edf875004c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.889171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa449ad931343109be111edf875004c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.890065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa449ad931343109be111edf875004c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.904598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7aa7011-a334-42e7-89fd-3687f5076509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa449ad931343109be111edf875004c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:41.919400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1309/2631] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:41 2022] DELETE /identity/v3/users/daa449ad931343109be111edf875004c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:42.225336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:42.226986 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:42.242840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfb1d6-a662-4c44-8db1-9a54063067bf admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:42.315818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:42.316715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.316992 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.317260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] PATH_INFO: `/v3/projects/d3966dd17cdc43ad87ebbc4c0b89e85e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.318581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3966dd17cdc43ad87ebbc4c0b89e85e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:42.321160 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:42.342502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:42.373333 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3966dd17cdc43ad87ebbc4c0b89e85e', 'request_id': 'req-9ea8aed5-d3d4-4304-8841-b3d04316f850'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:42.379679 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3966dd17cdc43ad87ebbc4c0b89e85e', 'request_id': 'req-9ea8aed5-d3d4-4304-8841-b3d04316f850'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:42.385872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3966dd17cdc43ad87ebbc4c0b89e85e', 'request_id': 'req-9ea8aed5-d3d4-4304-8841-b3d04316f850'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:42.396574 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] The token cache is being invalidate because project d3966dd17cdc43ad87ebbc4c0b89e85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:42.396858 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:42.397468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9ea8aed5-d3d4-4304-8841-b3d04316f850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:42.399004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1323/2632] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:42 2022] DELETE /identity/v3/projects/d3966dd17cdc43ad87ebbc4c0b89e85e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:42.404038 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891793-7d73-4402-9869-47deed19bd2f None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.404906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891793-7d73-4402-9869-47deed19bd2f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.405202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891793-7d73-4402-9869-47deed19bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.424357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ae891793-7d73-4402-9869-47deed19bd2f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:42.425491 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ae891793-7d73-4402-9869-47deed19bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:42.483557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1310/2633] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:42.491446 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce631c-b27c-4f8d-92ec-045bab58f544 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.491733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce631c-b27c-4f8d-92ec-045bab58f544 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.492008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce631c-b27c-4f8d-92ec-045bab58f544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.512593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-82ce631c-b27c-4f8d-92ec-045bab58f544 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:42.513801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-82ce631c-b27c-4f8d-92ec-045bab58f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:42.521734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1324/2634] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:42.525970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891793-7d73-4402-9869-47deed19bd2f None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:42.535824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891793-7d73-4402-9869-47deed19bd2f None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:42.540900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:42.541505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.541782 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.542052 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.542770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:42.543074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:42.544704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:42.556930 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1311/2635] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:42.560953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce631c-b27c-4f8d-92ec-045bab58f544 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:42.570110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce631c-b27c-4f8d-92ec-045bab58f544 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:42.574752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:42.575354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.575660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.575904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.576549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:42.578450 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:42.605734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1325/2636] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:42 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:42.609963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:42.620686 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b8c7-e442-4325-9cb5-d8c736177870 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:42.675937 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:42.676479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.676759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.677032 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.677699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:42.680261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:42.700275 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1312/2637] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:42 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:42.704399 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:42.714405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25420ed-ecb9-4711-ac08-130de92e309e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:42.718898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:42.719515 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.719773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.720044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.720727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:42.722326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:42.732478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1326/2638] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:42.736123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:42.746467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71917f05-85ff-4332-aa1d-fe1a9cf06618 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:42.751079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf909099-91dc-4d38-9448-3939f29ced12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:42.751673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909099-91dc-4d38-9448-3939f29ced12 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.751951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909099-91dc-4d38-9448-3939f29ced12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.752219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909099-91dc-4d38-9448-3939f29ced12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.752901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf909099-91dc-4d38-9448-3939f29ced12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:42.754492 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf909099-91dc-4d38-9448-3939f29ced12 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:42.765578 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1313/2639] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:42.769478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:42.779138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c35b2-299a-45ad-8b3e-164ff5b81136 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:42.783694 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:42.784336 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.784613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.784883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] PATH_INFO: `/v3/projects/5ae76eb3fecc425fba69a13dcc3c0cd7/users/32129f48603a49d18c3c9c68ce3f32a9/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.799590 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae76eb3fecc425fba69a13dcc3c0cd7, user_id=32129f48603a49d18c3c9c68ce3f32a9, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:42.802194 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:42.815419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1327/2640] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:42 2022] PUT /identity/v3/projects/5ae76eb3fecc425fba69a13dcc3c0cd7/users/32129f48603a49d18c3c9c68ce3f32a9/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:42.826668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:42.826957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:42.827234 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:42.855815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] MFA Rules not processed for user `32129f48603a49d18c3c9c68ce3f32a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:42.857097 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:42.866189 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:42.933712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1314/2641] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:42.938454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.003448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbee04-8650-48df-9f01-b7cf8ce349d0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.008563 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.009052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.009334 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.009610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.010101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.010292 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.011643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.012183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.025740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af956c1-c04f-42ee-a434-2418bfbfc58a None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.030857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.031513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.031862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.032064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] PATH_INFO: `/v3/users/a1b1c564bb354d0e850dbbdf243b7a8d` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.033403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b1c564bb354d0e850dbbdf243b7a8d)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.035365 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.039758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1328/2642] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:42 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:43.043808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.077834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:43.087717 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b1c564bb354d0e850dbbdf243b7a8d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.088395 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b1c564bb354d0e850dbbdf243b7a8d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.095374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b1c564bb354d0e850dbbdf243b7a8d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.096037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b1c564bb354d0e850dbbdf243b7a8d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.109036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-13fbde45-d33d-4000-9a61-eb0e7ad051f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b1c564bb354d0e850dbbdf243b7a8d'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.117532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc691f-8f3e-4315-bb9f-19ed5a25427d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.122264 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.122880 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.122993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1315/2643] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:43 2022] DELETE /identity/v3/users/a1b1c564bb354d0e850dbbdf243b7a8d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:43.123237 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.123625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.124303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.126347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.127370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.127653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.127951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.152524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1329/2644] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:43 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:43.152734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:43.152734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.153423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.155074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.167651 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544df91-beea-402b-b113-19f124ebb8ca admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.212558 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1316/2645] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:43.222188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.223085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.223622 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.223730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.223966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.224234 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.224921 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.227166 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.237078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1330/2646] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:43.241068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.250645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c01a8-5f23-42b3-9a9e-f5ffa3055e5c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.253630 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:43.255945 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.256862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.257143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.257412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] PATH_INFO: `/v3/projects/097486206a96404586f22cea5b7424e1/users/d2d214ea3e954d318ab3466e5f40b841/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.274862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097486206a96404586f22cea5b7424e1, user_id=d2d214ea3e954d318ab3466e5f40b841, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.277525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.290153 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f749-1cd0-407b-ae4f-c053dc42fe1c None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.292135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1331/2647] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:43 2022] PUT /identity/v3/projects/097486206a96404586f22cea5b7424e1/users/d2d214ea3e954d318ab3466e5f40b841/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:43.295964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.361150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c69a-6b27-452e-a012-8ef7c1e8e708 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.361884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47e998-dbb1-49a4-93a7-359e37594c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.362570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e998-dbb1-49a4-93a7-359e37594c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.362853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e998-dbb1-49a4-93a7-359e37594c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.363131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e998-dbb1-49a4-93a7-359e37594c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.366338 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.366951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.367284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.367552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.368233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.369808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.373137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47e998-dbb1-49a4-93a7-359e37594c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.374612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47e998-dbb1-49a4-93a7-359e37594c70 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.380281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1332/2648] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:43.384637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.386264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1317/2649] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:43.399354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940018-5ed3-4317-8af6-2f05de3e5eef admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.404560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.405223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.405531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.405802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] PATH_INFO: `/v3/projects/097486206a96404586f22cea5b7424e1/users/d2d214ea3e954d318ab3466e5f40b841/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.407897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=097486206a96404586f22cea5b7424e1, user_id=d2d214ea3e954d318ab3466e5f40b841, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.410765 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.422888 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1333/2650] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:43 2022] PUT /identity/v3/projects/097486206a96404586f22cea5b7424e1/users/d2d214ea3e954d318ab3466e5f40b841/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:43.437015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.437695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.437695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.468434 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] MFA Rules not processed for user `d2d214ea3e954d318ab3466e5f40b841`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:43.469573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.548942 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1318/2651] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:43.562260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.564078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.579708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:43.627933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d7b11-3256-402e-a6e0-9aaa8ec625bf admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.631988 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.632752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.633433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.633705 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.643438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.644959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.655387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1334/2652] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:43.659119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.660778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.735245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da4133-4272-44b6-b41e-0c1b0c7c9fd4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.737431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.739941 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.740584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.740861 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.741132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] PATH_INFO: `/v3/projects/bca744c9022d459abb1a451d87868bf6` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.742864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca744c9022d459abb1a451d87868bf6)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.744757 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.747371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf512f-bea5-4ea9-a542-31a755f466f5 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.751575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.752188 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.752468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.752909 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:43.753158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.755621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.793641 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca744c9022d459abb1a451d87868bf6', 'request_id': 'req-6459624b-9cc9-45a9-8bb2-d880becedc26'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.799643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca744c9022d459abb1a451d87868bf6', 'request_id': 'req-6459624b-9cc9-45a9-8bb2-d880becedc26'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.805935 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca744c9022d459abb1a451d87868bf6', 'request_id': 'req-6459624b-9cc9-45a9-8bb2-d880becedc26'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.817720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.818582 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] The token cache is being invalidate because project bca744c9022d459abb1a451d87868bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:43.818873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.819335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.819541 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.821635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1319/2653] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:43 2022] DELETE /identity/v3/projects/bca744c9022d459abb1a451d87868bf6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:43.825565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:43.826957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:43.829637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1335/2654] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:43.895894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459624b-9cc9-45a9-8bb2-d880becedc26 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:43.901586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:43.902283 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:43.902570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:43.902847 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] PATH_INFO: `/v3/users/21bf785b9d674741a53ea727f5370fc1` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:43.904049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bf785b9d674741a53ea727f5370fc1)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:43.906869 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:43.968498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bf785b9d674741a53ea727f5370fc1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.969262 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bf785b9d674741a53ea727f5370fc1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.979432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bf785b9d674741a53ea727f5370fc1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.979432 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bf785b9d674741a53ea727f5370fc1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:43.989929 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c319c940-027a-4367-a9c3-39a180646b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bf785b9d674741a53ea727f5370fc1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:44.003467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1320/2655] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:43 2022] DELETE /identity/v3/users/21bf785b9d674741a53ea727f5370fc1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:44.271413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:44.282122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e086-dc9d-401b-a64c-db8b4d729d6a service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:44.336777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:44.337412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.337684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.337950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] PATH_INFO: `/v3/projects/f533686e15354110961a86542d8d1006` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.339126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f533686e15354110961a86542d8d1006)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:44.340982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:44.390744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f533686e15354110961a86542d8d1006', 'request_id': 'req-6f97484f-3a91-42f9-b180-099dc24ae57b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:44.398124 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f533686e15354110961a86542d8d1006', 'request_id': 'req-6f97484f-3a91-42f9-b180-099dc24ae57b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:44.399575 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:44.405038 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f533686e15354110961a86542d8d1006', 'request_id': 'req-6f97484f-3a91-42f9-b180-099dc24ae57b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:44.418602 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] The token cache is being invalidate because project f533686e15354110961a86542d8d1006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:44.418900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:44.419632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6f97484f-3a91-42f9-b180-099dc24ae57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:44.421405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1336/2656] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:44 2022] DELETE /identity/v3/projects/f533686e15354110961a86542d8d1006 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:44.426420 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881198a-da0a-41e4-8330-1143bd3940e9 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.426738 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881198a-da0a-41e4-8330-1143bd3940e9 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.427041 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881198a-da0a-41e4-8330-1143bd3940e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.447474 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8881198a-da0a-41e4-8330-1143bd3940e9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:44.448860 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8881198a-da0a-41e4-8330-1143bd3940e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:44.459103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:44.512653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1321/2657] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:44.521315 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ddd21-f4c5-445a-b195-bdbd86722eb1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.521671 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ddd21-f4c5-445a-b195-bdbd86722eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.521946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ddd21-f4c5-445a-b195-bdbd86722eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.548071 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2e9ddd21-f4c5-445a-b195-bdbd86722eb1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:44.549538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2e9ddd21-f4c5-445a-b195-bdbd86722eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:44.560902 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1337/2658] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:44.565241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881198a-da0a-41e4-8330-1143bd3940e9 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:44.576789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881198a-da0a-41e4-8330-1143bd3940e9 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:44.582039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:44.582718 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.583001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.583378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.583969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:44.590674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:44.592261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:44.604778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1322/2659] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:44.609311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ddd21-f4c5-445a-b195-bdbd86722eb1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:44.618541 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ddd21-f4c5-445a-b195-bdbd86722eb1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:44.623322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:44.623929 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.624210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.624485 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.625132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:44.627497 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:44.657360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1338/2660] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:44 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:44.661555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:44.672353 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7081c-117c-441f-ac31-3f238e85839a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:44.728002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:44.728614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.728904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.729179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.729870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:44.731813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:44.752735 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1323/2661] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:44 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:44.757342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:44.767505 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7627-1656-41d4-8b00-b350a30fc0b1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:44.772257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:44.772797 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.773094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.773870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.774593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:44.776152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:44.785761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1339/2662] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:44.790150 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:44.800162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338bf7-f269-434d-ab37-cdf63abfef4d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:44.804846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d560f-9dee-4d03-be4b-745ae70bee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:44.805447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d560f-9dee-4d03-be4b-745ae70bee71 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.805728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d560f-9dee-4d03-be4b-745ae70bee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.806002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d560f-9dee-4d03-be4b-745ae70bee71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.806727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d560f-9dee-4d03-be4b-745ae70bee71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:44.808336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d560f-9dee-4d03-be4b-745ae70bee71 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:44.818723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1324/2663] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:44.823140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:44.832773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39d0d2-46d6-450a-b1c4-98b8678b0e38 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:44.837859 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:44.838533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.838807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.839074 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] PATH_INFO: `/v3/projects/30bbe79c037c4ef88daed662daaa2d9c/users/c7ee9761a67b4627a266f18acff30ed7/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.853057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bbe79c037c4ef88daed662daaa2d9c, user_id=c7ee9761a67b4627a266f18acff30ed7, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:44.855693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:44.868123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1340/2664] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:44 2022] PUT /identity/v3/projects/30bbe79c037c4ef88daed662daaa2d9c/users/c7ee9761a67b4627a266f18acff30ed7/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:44.878445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac6875-022a-427b-bf9e-a1d30371bed4 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:44.878731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac6875-022a-427b-bf9e-a1d30371bed4 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:44.879003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac6875-022a-427b-bf9e-a1d30371bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:44.911514 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e0ac6875-022a-427b-bf9e-a1d30371bed4 None None] MFA Rules not processed for user `c7ee9761a67b4627a266f18acff30ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:44.912740 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e0ac6875-022a-427b-bf9e-a1d30371bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:44.975185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1325/2665] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:44.979674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:45.044634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8f93e-35a0-4238-ac6a-e7a0be7ac5f3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:45.049684 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:45.050332 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.050640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.050993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.051722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:45.053697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:45.084214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1341/2666] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:44 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:45.085663 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac6875-022a-427b-bf9e-a1d30371bed4 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:45.097971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac6875-022a-427b-bf9e-a1d30371bed4 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:45.117976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:45.176181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:45.176901 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.177168 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.177433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.178109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:45.180835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:45.202345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1326/2667] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:45 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:45.207330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:45.219718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8afa-f9f1-43b6-8849-f1fb26d43228 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:45.226898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:45.227855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.228203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.228551 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.229325 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:45.231178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:45.243919 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1342/2668] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:45.248479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:45.260459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8afe-7b60-45f4-bc77-f52549d1f6ab admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:45.265071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:45.265842 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.266154 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.266497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] PATH_INFO: `/v3/projects/37ee55619bbb4d6e9a48a428cdf872a1/users/1fb8a543fd1641698e04a7a4bdd04fba/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.284255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ee55619bbb4d6e9a48a428cdf872a1, user_id=1fb8a543fd1641698e04a7a4bdd04fba, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:45.286464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:45.301662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1327/2669] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:45 2022] PUT /identity/v3/projects/37ee55619bbb4d6e9a48a428cdf872a1/users/1fb8a543fd1641698e04a7a4bdd04fba/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:45.307183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:45.319985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919512e3-c6f7-4632-ab73-6020c970b111 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:45.382365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:45.394005 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e5151-d6c5-4ab6-b5ee-9dc294d09de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:45.394834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e5151-d6c5-4ab6-b5ee-9dc294d09de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.395239 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e5151-d6c5-4ab6-b5ee-9dc294d09de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.395729 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e5151-d6c5-4ab6-b5ee-9dc294d09de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.396535 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e5151-d6c5-4ab6-b5ee-9dc294d09de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:45.398341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e5151-d6c5-4ab6-b5ee-9dc294d09de7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:45.418469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1343/2670] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:45.418601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:45.427213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dbbb4-b874-4476-8073-bd0c672c439f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:45.432875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:45.433537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.433815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.434116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] PATH_INFO: `/v3/projects/37ee55619bbb4d6e9a48a428cdf872a1/users/1fb8a543fd1641698e04a7a4bdd04fba/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.436311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ee55619bbb4d6e9a48a428cdf872a1, user_id=1fb8a543fd1641698e04a7a4bdd04fba, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:45.439236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:45.450079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1328/2671] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:45 2022] PUT /identity/v3/projects/37ee55619bbb4d6e9a48a428cdf872a1/users/1fb8a543fd1641698e04a7a4bdd04fba/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:45.468248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.468531 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.468805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.496102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] MFA Rules not processed for user `1fb8a543fd1641698e04a7a4bdd04fba`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:45.497280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:45.563998 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1344/2672] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:45.574945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:45.576673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:45.635938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a638e9-2e4f-4818-a68d-e73f8b5ebe56 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:45.639673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:45.640298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:45.640579 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:45.640856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:45.649874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:45.651338 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:45.660938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1329/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:46.945072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:46.947198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.013988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:47.014502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603505c-0bec-4760-be88-5f5d9b51d67f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.018616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.019311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.019631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.019900 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] PATH_INFO: `/v3/users/5d3524ee350f4f7c8f581f73272c0cd2` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.021056 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3524ee350f4f7c8f581f73272c0cd2)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:47.022985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:47.024356 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3786-8104-4636-90c4-a724d236d23d service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.029165 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.029786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.030065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.030376 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] PATH_INFO: `/v3/users/c7ee9761a67b4627a266f18acff30ed7` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.031559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ee9761a67b4627a266f18acff30ed7)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:47.033450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:47.074477 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3524ee350f4f7c8f581f73272c0cd2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.075183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3524ee350f4f7c8f581f73272c0cd2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.082552 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3524ee350f4f7c8f581f73272c0cd2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.082914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ee9761a67b4627a266f18acff30ed7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.083559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ee9761a67b4627a266f18acff30ed7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.090914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3524ee350f4f7c8f581f73272c0cd2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.091731 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ee9761a67b4627a266f18acff30ed7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.092389 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ee9761a67b4627a266f18acff30ed7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.097204 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:47.103693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:47.105897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c20951f0-1903-462a-b15b-f85afaff60ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3524ee350f4f7c8f581f73272c0cd2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.110651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-28b98a08-e3e8-4ba9-b31c-a6ce61aebcf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ee9761a67b4627a266f18acff30ed7'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.114285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1345/2674] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:46 2022] DELETE /identity/v3/users/5d3524ee350f4f7c8f581f73272c0cd2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:47.119581 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.120296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.120787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.129059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1330/2675] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:47 2022] DELETE /identity/v3/users/c7ee9761a67b4627a266f18acff30ed7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:47.133797 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.134083 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.134459 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.142693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:47.145400 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.155018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:47.156225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.206267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1346/2676] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:47.215993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:47.217311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1331/2677] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:47.217438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.226016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:47.227949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.272949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1eb31-628f-4fbf-9cfc-00426e12018f None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.276614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.277208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.277482 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.277751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.285398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9daf3-dac0-4c73-8744-4a67b638780f None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.286818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:47.288219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:47.289658 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.290304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.290586 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.290856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.298326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1347/2678] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:47.299949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:47.301386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:47.311809 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1332/2679] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:47.666331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:47.668650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.679596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:47.681113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.686893 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548488d3-e4f5-4945-8d60-864f268081ab service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.692809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.693802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.694374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.694727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] PATH_INFO: `/v3/projects/30bbe79c037c4ef88daed662daaa2d9c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.696430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bbe79c037c4ef88daed662daaa2d9c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:47.698653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:47.710414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aa25c-503a-4da5-afaa-bb610b57029f service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.720392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.721201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.721545 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.721823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] PATH_INFO: `/v3/projects/501eb37ddca14e4986ff53ef54405906` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.723092 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501eb37ddca14e4986ff53ef54405906)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:47.725340 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:47.768346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bbe79c037c4ef88daed662daaa2d9c', 'request_id': 'req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.782976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bbe79c037c4ef88daed662daaa2d9c', 'request_id': 'req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.789710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501eb37ddca14e4986ff53ef54405906', 'request_id': 'req-3a784466-037f-4a68-b93e-27791c344509'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.790225 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bbe79c037c4ef88daed662daaa2d9c', 'request_id': 'req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.797529 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501eb37ddca14e4986ff53ef54405906', 'request_id': 'req-3a784466-037f-4a68-b93e-27791c344509'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.804247 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501eb37ddca14e4986ff53ef54405906', 'request_id': 'req-3a784466-037f-4a68-b93e-27791c344509'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.804702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] The token cache is being invalidate because project 30bbe79c037c4ef88daed662daaa2d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:47.805266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.805833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.807376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1348/2680] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:47 2022] DELETE /identity/v3/projects/30bbe79c037c4ef88daed662daaa2d9c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:47.811443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:47.816128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.822259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] The token cache is being invalidate because project 501eb37ddca14e4986ff53ef54405906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:47.822588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.823305 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-3a784466-037f-4a68-b93e-27791c344509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:47.824826 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1333/2681] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:47 2022] DELETE /identity/v3/projects/501eb37ddca14e4986ff53ef54405906 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:47.829700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd5a0-4a53-4cc6-90e3-443f02c4d2b7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.830255 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd5a0-4a53-4cc6-90e3-443f02c4d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.830756 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd5a0-4a53-4cc6-90e3-443f02c4d2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.845430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:47.850192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:47.856295 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-eb7bd5a0-4a53-4cc6-90e3-443f02c4d2b7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:47.857891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-eb7bd5a0-4a53-4cc6-90e3-443f02c4d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.892297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f683a6-3c1b-4bb5-8e51-f39c683c5e31 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.935722 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1334/2682] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:47.943450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32d0d-cda9-4288-9474-ae5d4f840599 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.943766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32d0d-cda9-4288-9474-ae5d4f840599 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.944017 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32d0d-cda9-4288-9474-ae5d4f840599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.957970 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.958905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.959182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.959465 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] PATH_INFO: `/v3/users/1fb8a543fd1641698e04a7a4bdd04fba` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:47.960699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb8a543fd1641698e04a7a4bdd04fba)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:47.963767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:47.966309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-34a32d0d-cda9-4288-9474-ae5d4f840599 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:47.967870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-34a32d0d-cda9-4288-9474-ae5d4f840599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:47.976985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1335/2683] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:47.981347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32d0d-cda9-4288-9474-ae5d4f840599 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:47.991858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32d0d-cda9-4288-9474-ae5d4f840599 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:47.997408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:47.998664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:47.999026 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:47.999617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.000813 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:48.001131 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.003418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.018985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb8a543fd1641698e04a7a4bdd04fba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.019762 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb8a543fd1641698e04a7a4bdd04fba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.020884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1336/2684] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:25:48.025636 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.028592 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb8a543fd1641698e04a7a4bdd04fba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.036309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5ec5a-ec8b-4208-ac14-9d0ca7b0c46f admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.037066 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb8a543fd1641698e04a7a4bdd04fba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.047956 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.048684 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.048976 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.049287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.049975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.051294 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb8a543fd1641698e04a7a4bdd04fba'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.051914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.058140 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1349/2685] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:47 2022] DELETE /identity/v3/users/1fb8a543fd1641698e04a7a4bdd04fba => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:48.083984 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1337/2686] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:48.088561 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.090083 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.158852 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:48.182747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71b109-c1e2-40ae-87a1-b40bc480b237 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.258809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.259445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.259956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.259956 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.260631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.262616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.288283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1350/2687] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:48.292386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.306113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8c0e-7d91-4641-a907-4835e749b324 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.312191 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.313065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.313657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.313920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.314673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.316398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.327965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1338/2688] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:48.331985 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.342266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7391d2b-a8ca-4bee-8d59-7cfd0c7c1bab admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.346969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.347583 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.347857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.348129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.348816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.350419 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.361385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1351/2689] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:48.365936 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.377527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0fe78-b35d-49f5-afaa-46b45b559699 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.383344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.384523 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe67bc-a296-4213-ab4b-c5191797d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.385308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe67bc-a296-4213-ab4b-c5191797d33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.385722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.385857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe67bc-a296-4213-ab4b-c5191797d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.386145 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe67bc-a296-4213-ab4b-c5191797d33c admin admin] PATH_INFO: `/v3/projects/1ed2a7db693e45299cd2d13f24212b43/users/af9134ad03f649b98b0464a838877797/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.404644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00b0ac-3496-49c9-94f0-aa20a93f4630 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.408547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe67bc-a296-4213-ab4b-c5191797d33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed2a7db693e45299cd2d13f24212b43, user_id=af9134ad03f649b98b0464a838877797, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.409562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.410202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.410526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.410787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] PATH_INFO: `/v3/projects/37ee55619bbb4d6e9a48a428cdf872a1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.411973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ee55619bbb4d6e9a48a428cdf872a1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.412284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe67bc-a296-4213-ab4b-c5191797d33c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.414453 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.428682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1339/2690] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:48 2022] PUT /identity/v3/projects/1ed2a7db693e45299cd2d13f24212b43/users/af9134ad03f649b98b0464a838877797/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:48.467901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ee55619bbb4d6e9a48a428cdf872a1', 'request_id': 'req-210d987c-f3d2-40c5-9045-10a93388e4d3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.476406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ee55619bbb4d6e9a48a428cdf872a1', 'request_id': 'req-210d987c-f3d2-40c5-9045-10a93388e4d3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.483164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ee55619bbb4d6e9a48a428cdf872a1', 'request_id': 'req-210d987c-f3d2-40c5-9045-10a93388e4d3'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.496467 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] The token cache is being invalidate because project 37ee55619bbb4d6e9a48a428cdf872a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:48.496901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.497758 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-210d987c-f3d2-40c5-9045-10a93388e4d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.499023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.499321 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.499548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1352/2691] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:48 2022] DELETE /identity/v3/projects/37ee55619bbb4d6e9a48a428cdf872a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:48.499666 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.504013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b1e97-7d3c-42ed-8905-b707a9d62cc5 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.504297 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b1e97-7d3c-42ed-8905-b707a9d62cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.504573 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b1e97-7d3c-42ed-8905-b707a9d62cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.524344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-527b1e97-7d3c-42ed-8905-b707a9d62cc5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:48.525569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-527b1e97-7d3c-42ed-8905-b707a9d62cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.528215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] MFA Rules not processed for user `af9134ad03f649b98b0464a838877797`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:48.529402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.576972 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:48.590284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1353/2692] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:48.598471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1bf02-3954-4446-85f0-d61236fda024 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.598981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1bf02-3954-4446-85f0-d61236fda024 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.599258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1bf02-3954-4446-85f0-d61236fda024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.604221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1340/2693] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:48.615878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.618438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.623130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cff1bf02-3954-4446-85f0-d61236fda024 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:48.624385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cff1bf02-3954-4446-85f0-d61236fda024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.633228 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1354/2694] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:48.637331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1bf02-3954-4446-85f0-d61236fda024 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.641139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:48.646635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1bf02-3954-4446-85f0-d61236fda024 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.651817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.652478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.652759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.653028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.653743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:48.654041 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.655725 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.668539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1355/2695] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:25:48.672774 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.682959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5441e-33b7-44d6-8830-90a6d92e44d0 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.683959 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85498c2-5c91-49a0-97e0-cba6618dc5d8 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.687469 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.687833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.688062 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.688340 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.688555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.688669 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.688839 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.689108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.689299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.691261 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.698343 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.700490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.711004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1341/2696] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:48.718802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1356/2697] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:48.723139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.735548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdc1d-55ce-4374-ad9a-88f27d63d908 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.740508 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.743668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.798884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.799500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.799777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.800048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.800708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.802643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.811045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9634-3a7c-453e-8e4b-c5076450312f admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.816281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.816915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.817218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.817502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] PATH_INFO: `/v3/users/af9134ad03f649b98b0464a838877797` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.818653 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9134ad03f649b98b0464a838877797)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.820580 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.825428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1342/2698] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:48.829493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.839139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d29a75-511b-490b-b4e8-cd4bc2a50966 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.844559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.845422 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.845743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.846160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.847014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.848811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.863037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1343/2699] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:48.864031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.869746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9134ad03f649b98b0464a838877797'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.870511 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9134ad03f649b98b0464a838877797'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.874350 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e3d7d-672e-423e-9f8e-b03f3803fe0d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.879374 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9134ad03f649b98b0464a838877797'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.879947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.880697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.881238 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.881862 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.882593 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.884219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.889110 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9134ad03f649b98b0464a838877797'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.897019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1344/2700] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:48.901139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:48.902603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0ea65a0f-214d-42aa-9e8e-ec0b9a53b39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9134ad03f649b98b0464a838877797'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:48.909079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1357/2701] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:48 2022] DELETE /identity/v3/users/af9134ad03f649b98b0464a838877797 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:48.913293 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.913582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.914739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc973-3a99-4b2c-8991-64636d62b665 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:48.915039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.933867 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:48.935085 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:48.967427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:48.974139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86ad8c-f096-44ce-9ff1-47022c6c5fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:48.974833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ad8c-f096-44ce-9ff1-47022c6c5fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:48.975109 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ad8c-f096-44ce-9ff1-47022c6c5fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:48.975402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ad8c-f096-44ce-9ff1-47022c6c5fd1 admin admin] PATH_INFO: `/v3/projects/9952ba54775f407199a7efcf7eef5886/users/78773f290ac64d0084da4662d732379f/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:48.991177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86ad8c-f096-44ce-9ff1-47022c6c5fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9952ba54775f407199a7efcf7eef5886, user_id=78773f290ac64d0084da4662d732379f, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:48.993938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86ad8c-f096-44ce-9ff1-47022c6c5fd1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:48.998989 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1358/2702] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:49.009126 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.010538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.011132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1345/2703] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:48 2022] PUT /identity/v3/projects/9952ba54775f407199a7efcf7eef5886/users/78773f290ac64d0084da4662d732379f/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:49.022297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.022893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.022893 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.043172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:49.051714 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] MFA Rules not processed for user `78773f290ac64d0084da4662d732379f`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:49.052924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.071824 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4a7ae-f095-45e1-a544-2afe53435401 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.119977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1346/2704] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:49.124408 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.125311 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.125703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.125978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.126286 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.126560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.187210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.188668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.191533 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f55b-68d7-4e81-87fd-1637029b30db None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.197118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.197824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.198407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.198758 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.199588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.200454 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1359/2705] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:49.201680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.235196 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1347/2706] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:49.239407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.249714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd19736-0875-4a35-8a84-1211be2ff137 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.294158 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:49.315633 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.316353 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.316645 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.316953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.317627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.320172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.345150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1360/2707] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:49.349029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.367838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacaaaa-d28e-43ab-b32c-e9820fadbfca admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.372988 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.373606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.373887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.374161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.374891 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.376518 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.388631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1348/2708] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:49.393095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.408086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c01859-ccc4-493d-be3d-21399e4d3cf5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.413696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.414749 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.422996 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.423323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] PATH_INFO: `/v3/projects/11da9c5a5ff543f9b7672ed86cceefae/users/90828328215f4860aba4e5e409227de8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.442665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=11da9c5a5ff543f9b7672ed86cceefae, user_id=90828328215f4860aba4e5e409227de8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.445128 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.461793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1361/2709] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:49 2022] PUT /identity/v3/projects/11da9c5a5ff543f9b7672ed86cceefae/users/90828328215f4860aba4e5e409227de8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:49.465667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.479786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e48c16-9167-47e8-9785-8bfe07febdf7 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.501019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.503994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.553972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.555065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.555349 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.555623 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.556803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.563143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.575460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1349/2710] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:49.579363 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.590440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee059-b0dd-41a6-a07c-648041e1da63 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.596832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ef85a-d9ad-474c-aa13-a599efcf263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.597650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ef85a-d9ad-474c-aa13-a599efcf263a admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.598044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ef85a-d9ad-474c-aa13-a599efcf263a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.598364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ef85a-d9ad-474c-aa13-a599efcf263a admin admin] PATH_INFO: `/v3/projects/11da9c5a5ff543f9b7672ed86cceefae/users/90828328215f4860aba4e5e409227de8/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.600372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ef85a-d9ad-474c-aa13-a599efcf263a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11da9c5a5ff543f9b7672ed86cceefae, user_id=90828328215f4860aba4e5e409227de8, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.603091 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ef85a-d9ad-474c-aa13-a599efcf263a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.603360 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b30380-b4a7-43bc-a283-99de07b221ba admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.608784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.609394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:49.609512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.609768 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.610047 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] PATH_INFO: `/v3/projects/1ed2a7db693e45299cd2d13f24212b43` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.612070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed2a7db693e45299cd2d13f24212b43)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.614189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.620117 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1350/2711] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:49 2022] PUT /identity/v3/projects/11da9c5a5ff543f9b7672ed86cceefae/users/90828328215f4860aba4e5e409227de8/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:49.630014 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.630535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.630825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.661701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] MFA Rules not processed for user `90828328215f4860aba4e5e409227de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:49.663192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.670162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed2a7db693e45299cd2d13f24212b43', 'request_id': 'req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:49.677436 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed2a7db693e45299cd2d13f24212b43', 'request_id': 'req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:49.683904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed2a7db693e45299cd2d13f24212b43', 'request_id': 'req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:49.696208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] The token cache is being invalidate because project 1ed2a7db693e45299cd2d13f24212b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:49.696488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:49.697187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-05c6f12b-a22b-4f3e-98bb-f9d533313ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:49.698751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1362/2712] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:49 2022] DELETE /identity/v3/projects/1ed2a7db693e45299cd2d13f24212b43 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:49.703589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebec5-857f-4b2e-9d45-2aff5a8f6f32 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.703931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebec5-857f-4b2e-9d45-2aff5a8f6f32 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.704211 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebec5-857f-4b2e-9d45-2aff5a8f6f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.723524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-7ffebec5-857f-4b2e-9d45-2aff5a8f6f32 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:49.724734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7ffebec5-857f-4b2e-9d45-2aff5a8f6f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.737834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1351/2713] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:49.749158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.750597 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.762440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:49.791029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1363/2714] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:49.798917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ca12-9b96-46f5-a293-e87cf894b81a None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.799214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ca12-9b96-46f5-a293-e87cf894b81a None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.799769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ca12-9b96-46f5-a293-e87cf894b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.813477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c4db-dabf-4a91-9d67-f56c59de1bbb None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.817934 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.818625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.818951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.819227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.820040 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e232ca12-9b96-46f5-a293-e87cf894b81a None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:49.822095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e232ca12-9b96-46f5-a293-e87cf894b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:49.830068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.831565 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.831726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1364/2715] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:49.836102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ca12-9b96-46f5-a293-e87cf894b81a None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.843844 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1352/2716] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:49.849488 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ca12-9b96-46f5-a293-e87cf894b81a None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.855019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.855637 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.855944 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.856214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.856906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:49.857208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.858822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.871504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1365/2717] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 22:25:49.879004 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.891892 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8fd34-4ea9-4872-8a5b-937f7adde717 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:49.897386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:49.898011 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:49.898410 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:49.898695 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:49.899383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:49.901302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:49.940149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1353/2718] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:49.944757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:49.955562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86f8e-e948-4eba-9143-0517d1204f0e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.017518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.018171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.018495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.018757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.019438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.021347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.047899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1366/2719] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:49 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:50.053658 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.065079 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c04725-c902-481d-9f7b-c9046a591aba admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.069833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.070504 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.070787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.071064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.071793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.073393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.086945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1354/2720] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:50.091368 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.104207 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a861e-9c03-46e1-b4f5-1eef6f8afe3d admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.107289 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8221bb-263c-4c27-90c8-ac04d1b0b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.107899 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8221bb-263c-4c27-90c8-ac04d1b0b9ca admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.108177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8221bb-263c-4c27-90c8-ac04d1b0b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.108443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8221bb-263c-4c27-90c8-ac04d1b0b9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.109129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8221bb-263c-4c27-90c8-ac04d1b0b9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.110733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8221bb-263c-4c27-90c8-ac04d1b0b9ca admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.126777 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1367/2721] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:50.128103 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.138910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0e03-761f-41fe-a562-4f4b50433999 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.143833 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.144508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.144792 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.145071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] PATH_INFO: `/v3/projects/8be594ef5f3c43ac93450210475b6124/users/879d69c60bdc4d049fb3e782fa17306a/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.160402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be594ef5f3c43ac93450210475b6124, user_id=879d69c60bdc4d049fb3e782fa17306a, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.163105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.179381 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1355/2722] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:50 2022] PUT /identity/v3/projects/8be594ef5f3c43ac93450210475b6124/users/879d69c60bdc4d049fb3e782fa17306a/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:50.184935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.185248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.185524 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.207308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:50.208593 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:50.226086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.228699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:50.250366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:50.272503 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1368/2723] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:50.282347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.283737 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:50.299401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaf87c-a7c3-4709-9885-69c39eb9d0e9 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.304081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.305336 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.305616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.305881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] PATH_INFO: `/v3/users/78773f290ac64d0084da4662d732379f` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.307124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78773f290ac64d0084da4662d732379f)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.309046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.324944 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:50.341641 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8e31c-89d6-49e1-ac0b-b6f5359fcace None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.345519 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaedb4-9390-4627-97a9-f12dec681ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.346131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaedb4-9390-4627-97a9-f12dec681ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.346440 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaedb4-9390-4627-97a9-f12dec681ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.346711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaedb4-9390-4627-97a9-f12dec681ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.354999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78773f290ac64d0084da4662d732379f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.355662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78773f290ac64d0084da4662d732379f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.356881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaedb4-9390-4627-97a9-f12dec681ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.358372 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaedb4-9390-4627-97a9-f12dec681ed4 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.362450 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78773f290ac64d0084da4662d732379f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.363100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78773f290ac64d0084da4662d732379f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.368831 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1369/2724] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:50.375762 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78773f290ac64d0084da4662d732379f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.390118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1356/2725] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:50 2022] DELETE /identity/v3/users/78773f290ac64d0084da4662d732379f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:50.394648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.394977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.395233 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.413714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:50.415475 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:50.479169 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1370/2726] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:50.490115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.491659 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:50.552979 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d6dd8-e25e-479a-ba4d-900113cd3927 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.557344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.557827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.558107 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.558418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.568885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.570407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.579832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1357/2727] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:50.833376 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.840949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:50.862834 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235ea05-cc42-410d-bcfb-201323ba2c32 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:50.868887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:50.869677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:50.870175 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:50.870572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] PATH_INFO: `/v3/users/32129f48603a49d18c3c9c68ce3f32a9` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:50.872670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32129f48603a49d18c3c9c68ce3f32a9)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:50.874887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:50.938002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32129f48603a49d18c3c9c68ce3f32a9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.939418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32129f48603a49d18c3c9c68ce3f32a9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.948995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32129f48603a49d18c3c9c68ce3f32a9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.963226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32129f48603a49d18c3c9c68ce3f32a9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.986970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:50.987118 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b9f172c7-5a11-4b4f-b4f5-c856fc811c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32129f48603a49d18c3c9c68ce3f32a9'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:50.988409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:50.995997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1371/2728] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:50 2022] DELETE /identity/v3/users/32129f48603a49d18c3c9c68ce3f32a9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:51.000219 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:51.000789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:51.001526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:51.007058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01044959-3d5f-4824-9be4-8187f1133cb2 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:51.031218 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:51.033090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:51.059877 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:51.089535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:51.091302 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:51.091789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:51.092551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] PATH_INFO: `/v3/projects/9952ba54775f407199a7efcf7eef5886` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:51.094513 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9952ba54775f407199a7efcf7eef5886)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:51.095355 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:51.097811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:51.121424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1372/2729] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:51.130445 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:51.132174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:51.169810 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9952ba54775f407199a7efcf7eef5886', 'request_id': 'req-cb6e5d06-656d-4855-ac70-728282856c84'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.181081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9952ba54775f407199a7efcf7eef5886', 'request_id': 'req-cb6e5d06-656d-4855-ac70-728282856c84'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.191259 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9952ba54775f407199a7efcf7eef5886', 'request_id': 'req-cb6e5d06-656d-4855-ac70-728282856c84'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.214975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] The token cache is being invalidate because project 9952ba54775f407199a7efcf7eef5886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:51.215497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.216438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.218311 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1358/2730] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:50 2022] DELETE /identity/v3/projects/9952ba54775f407199a7efcf7eef5886 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:51.219097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cfb83-3185-438c-82ac-7d48df0543fe None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:51.222645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:51.224664 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:51.291298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:51.292460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:51.292842 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:51.293627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:51.296491 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:51.319324 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5d06-656d-4855-ac70-728282856c84 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:51.329113 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:51.329778 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:51.330063 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:51.330374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] PATH_INFO: `/v3/users/90828328215f4860aba4e5e409227de8` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:51.331884 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90828328215f4860aba4e5e409227de8)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:51.333827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:51.412516 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:51.414726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90828328215f4860aba4e5e409227de8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.415052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:51.416065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90828328215f4860aba4e5e409227de8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.428281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1373/2731] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:51.433331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90828328215f4860aba4e5e409227de8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.434279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90828328215f4860aba4e5e409227de8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.450703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90828328215f4860aba4e5e409227de8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:51.452411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:51.471489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1359/2732] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:51 2022] DELETE /identity/v3/users/90828328215f4860aba4e5e409227de8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:51.984203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:51.986285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:52.024796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a69b3-184f-4563-ab17-133c87317230 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:52.044771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.045975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:52.147946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:52.149281 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.150707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.150707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] PATH_INFO: `/v3/projects/5ae76eb3fecc425fba69a13dcc3c0cd7` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.152676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae76eb3fecc425fba69a13dcc3c0cd7)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:52.154743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:52.156896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:52.184245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea5c2-7902-43c0-9c96-5d97c2e7cf0b admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:52.198022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:52.198736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.199018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.199322 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] PATH_INFO: `/v3/projects/11da9c5a5ff543f9b7672ed86cceefae` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.200609 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=11da9c5a5ff543f9b7672ed86cceefae)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:52.202543 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:52.225801 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae76eb3fecc425fba69a13dcc3c0cd7', 'request_id': 'req-56fdaca7-6d35-453e-ab2b-039d3b851e2c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.236081 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae76eb3fecc425fba69a13dcc3c0cd7', 'request_id': 'req-56fdaca7-6d35-453e-ab2b-039d3b851e2c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.243167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae76eb3fecc425fba69a13dcc3c0cd7', 'request_id': 'req-56fdaca7-6d35-453e-ab2b-039d3b851e2c'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.255717 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] The token cache is being invalidate because project 5ae76eb3fecc425fba69a13dcc3c0cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:52.256161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.257187 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.259023 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1374/2733] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:51 2022] DELETE /identity/v3/projects/5ae76eb3fecc425fba69a13dcc3c0cd7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:52.263243 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.264849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:52.271371 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11da9c5a5ff543f9b7672ed86cceefae', 'request_id': 'req-9da3ea9a-8922-4ae8-b836-8310676d21ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.283765 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11da9c5a5ff543f9b7672ed86cceefae', 'request_id': 'req-9da3ea9a-8922-4ae8-b836-8310676d21ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.298391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11da9c5a5ff543f9b7672ed86cceefae', 'request_id': 'req-9da3ea9a-8922-4ae8-b836-8310676d21ff'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.317315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] The token cache is being invalidate because project 11da9c5a5ff543f9b7672ed86cceefae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:52.317700 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.318413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-9da3ea9a-8922-4ae8-b836-8310676d21ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.319969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1360/2734] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:52 2022] DELETE /identity/v3/projects/11da9c5a5ff543f9b7672ed86cceefae => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:52.331790 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ab2c-6806-42ac-a8b9-254f6e691736 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.332290 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ab2c-6806-42ac-a8b9-254f6e691736 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.332573 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ab2c-6806-42ac-a8b9-254f6e691736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.347816 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdaca7-6d35-453e-ab2b-039d3b851e2c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:52.360975 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-cf36ab2c-6806-42ac-a8b9-254f6e691736 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:52.363716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-cf36ab2c-6806-42ac-a8b9-254f6e691736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:52.427660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:52.428971 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.429423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.430146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] PATH_INFO: `/v3/users/d2d214ea3e954d318ab3466e5f40b841` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.432280 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d214ea3e954d318ab3466e5f40b841)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:52.434676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:52.452837 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1361/2735] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:52.463020 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187317d4-90d4-445e-9a1f-633d1a5e5bc8 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.463548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187317d4-90d4-445e-9a1f-633d1a5e5bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.464415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187317d4-90d4-445e-9a1f-633d1a5e5bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.490548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-187317d4-90d4-445e-9a1f-633d1a5e5bc8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:52.492287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-187317d4-90d4-445e-9a1f-633d1a5e5bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:52.519801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1362/2736] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:52.521827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187317d4-90d4-445e-9a1f-633d1a5e5bc8 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.527707 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:52.533186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187317d4-90d4-445e-9a1f-633d1a5e5bc8 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:52.540539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:52.541320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.541701 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.542048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.542900 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:52.543304 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:52.545009 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:52.547307 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d214ea3e954d318ab3466e5f40b841'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.549957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d214ea3e954d318ab3466e5f40b841'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.561184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1363/2737] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:52.562366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.567266 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d214ea3e954d318ab3466e5f40b841'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.568570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:52.578867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72ed2e-0536-4815-ae3f-1c13ec35d166 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:52.580546 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d214ea3e954d318ab3466e5f40b841'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.585719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:52.587215 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.587887 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.589430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.590176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:52.592584 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:52.602288 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d214ea3e954d318ab3466e5f40b841'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:52.611584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1375/2738] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:52 2022] DELETE /identity/v3/users/d2d214ea3e954d318ab3466e5f40b841 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:52.635105 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1364/2739] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:52 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:52.639405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.640849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:52.783748 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4109-00c5-4b37-ad19-6d42b5959a67 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:52.911456 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:52.912115 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.912472 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.912890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.913706 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:52.916668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:52.952607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1376/2740] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:52 2022] POST /identity/v3/users => generated 291 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:52.953088 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.965737 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717c40c-a8bf-4afb-baa8-556961ab03a4 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:52.971347 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:52.971973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:52.972282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:52.972575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:52.973430 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:52.975354 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:52.993846 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1365/2741] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:52.994816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.995479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:52.997391 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:53.007560 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3a319-00c5-4fa2-b455-edc1565616dd admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.014743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.015375 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.015654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.015921 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.016615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.018223 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.024284 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e814-1509-40f7-8882-53bd3e7f5542 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.029982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.030814 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.031517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.031517 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] PATH_INFO: `/v3/projects/097486206a96404586f22cea5b7424e1` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.042419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1366/2742] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:53.043680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=097486206a96404586f22cea5b7424e1)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.046146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.047002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.060624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfff646-8658-4a40-9184-d5eda8593f4e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.069507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278ed7a-8e49-477b-8c56-dc9e2869d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.070521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278ed7a-8e49-477b-8c56-dc9e2869d3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.071044 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278ed7a-8e49-477b-8c56-dc9e2869d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.071537 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278ed7a-8e49-477b-8c56-dc9e2869d3b1 admin admin] PATH_INFO: `/v3/projects/609c6478307c44cc8668de99e6ee0448/users/7475e7349e004cc5b5d58fa57b0118cd/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.089920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278ed7a-8e49-477b-8c56-dc9e2869d3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609c6478307c44cc8668de99e6ee0448, user_id=7475e7349e004cc5b5d58fa57b0118cd, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.093213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278ed7a-8e49-477b-8c56-dc9e2869d3b1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.112639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1367/2743] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:53 2022] PUT /identity/v3/projects/609c6478307c44cc8668de99e6ee0448/users/7475e7349e004cc5b5d58fa57b0118cd/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:53.129407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.129698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.129973 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.137386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:53.143743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097486206a96404586f22cea5b7424e1', 'request_id': 'req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:53.161329 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097486206a96404586f22cea5b7424e1', 'request_id': 'req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:53.171298 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] MFA Rules not processed for user `7475e7349e004cc5b5d58fa57b0118cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:53.172562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097486206a96404586f22cea5b7424e1', 'request_id': 'req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:53.172830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:53.188016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] The token cache is being invalidate because project 097486206a96404586f22cea5b7424e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:53.190429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:53.191648 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-46b583c0-0ff5-44bd-8d85-01b5066c1c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:53.194868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1377/2744] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:52 2022] DELETE /identity/v3/projects/097486206a96404586f22cea5b7424e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:53.199591 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba787-9ee8-49ce-8e25-9957c2725132 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.200224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba787-9ee8-49ce-8e25-9957c2725132 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.200680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba787-9ee8-49ce-8e25-9957c2725132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.225078 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d13ba787-9ee8-49ce-8e25-9957c2725132 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:53.227381 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d13ba787-9ee8-49ce-8e25-9957c2725132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:53.276549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1368/2745] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:53.281776 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.284493 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:53.346525 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1378/2746] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:53.354890 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c160-2638-437f-a51e-d0315ee8cb67 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.355366 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c160-2638-437f-a51e-d0315ee8cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.355839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c160-2638-437f-a51e-d0315ee8cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.396928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f786c160-2638-437f-a51e-d0315ee8cb67 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:53.398217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f786c160-2638-437f-a51e-d0315ee8cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:53.412322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1379/2747] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:53.417739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c160-2638-437f-a51e-d0315ee8cb67 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.425339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dff67-bb44-4c3c-a4b8-36f7e083106e None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.433796 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c160-2638-437f-a51e-d0315ee8cb67 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.434025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.434551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.434945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.435229 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.435905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.437823 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.439063 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.439812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.440090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.440625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.441418 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:53.442918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.443345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.463216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1380/2748] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:53.468278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.484276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcb709-a8b9-4010-986a-dfc8e21d896e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.492057 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.492826 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.493106 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.494008 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.494718 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.495481 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1369/2749] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:53 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:53.497217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.500904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.522177 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:53.557631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1381/2750] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:53 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:53.558829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.614633 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747de29-29bc-4480-82ea-99356937d223 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.677401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f9f5-8143-48fa-b028-fce69c538c39 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.683634 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.695906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.696910 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.697556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.697958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.698253 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.698898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.699031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.699443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.701367 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.702409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.706656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.728222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1370/2751] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:53 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:53.733176 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.746863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f904c0-ec8b-41aa-b76a-fae5acc89926 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.753360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.754033 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.754406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.754626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.755339 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.755652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1382/2752] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:53 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:53.759076 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.760610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.771278 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1371/2753] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:53.775548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.778270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff196bd-14c1-441a-a169-c8dddf4d8571 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.785991 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d38e-9419-47ce-a1c6-c2e26c0cc885 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.788171 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.788809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.789635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.789917 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.790932 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.793432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.803333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.804175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.804464 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.805314 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] PATH_INFO: `/v3/projects/ab30a7dea9bd48b1b7a456226d35e515/users/0ef4ddfea7854e05a18fe921d8fb3a5b/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.817142 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1383/2754] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:53.821451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.827570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab30a7dea9bd48b1b7a456226d35e515, user_id=0ef4ddfea7854e05a18fe921d8fb3a5b, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.830601 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.840460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9503c4-49fe-4af8-87c8-96dda751756a admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.850320 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1372/2755] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:53 2022] PUT /identity/v3/projects/ab30a7dea9bd48b1b7a456226d35e515/users/0ef4ddfea7854e05a18fe921d8fb3a5b/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:53.854264 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.859712 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:53.937492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.938045 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.938364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.939162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.939881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.940081 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c000cd-4b92-4d08-aaaa-676690dfb07c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.941603 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.946849 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.948108 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.948419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.948696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.949421 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.951775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.958277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1384/2756] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:53.962464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.964697 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1373/2757] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:53.968642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:53.976146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8013fb-e6fa-413c-9746-ee69c90b7ea3 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.979205 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b8fe6-e0e0-48e2-ab36-06e15082dd0d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:53.985066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f69e-ce6b-4eed-8658-4aa29e813b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.985066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f69e-ce6b-4eed-8658-4aa29e813b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.985066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f69e-ce6b-4eed-8658-4aa29e813b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.985416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f69e-ce6b-4eed-8658-4aa29e813b7d admin admin] PATH_INFO: `/v3/projects/ab30a7dea9bd48b1b7a456226d35e515/users/0ef4ddfea7854e05a18fe921d8fb3a5b/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.985950 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d36eb5-7ae9-43f5-b452-bc8fb4452e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:53.987029 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d36eb5-7ae9-43f5-b452-bc8fb4452e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:53.987499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d36eb5-7ae9-43f5-b452-bc8fb4452e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:53.987776 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d36eb5-7ae9-43f5-b452-bc8fb4452e1f admin admin] PATH_INFO: `/v3/projects/5dbe1107329e42d4a5b58143434e2e5c/users/2b5749eb3af343e7b6bfafc68883c3ac/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:53.988678 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f69e-ce6b-4eed-8658-4aa29e813b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab30a7dea9bd48b1b7a456226d35e515, user_id=0ef4ddfea7854e05a18fe921d8fb3a5b, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:53.992029 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f69e-ce6b-4eed-8658-4aa29e813b7d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:53.995309 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:54.012371 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d36eb5-7ae9-43f5-b452-bc8fb4452e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbe1107329e42d4a5b58143434e2e5c, user_id=2b5749eb3af343e7b6bfafc68883c3ac, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.015378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1374/2758] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:53 2022] PUT /identity/v3/projects/ab30a7dea9bd48b1b7a456226d35e515/users/0ef4ddfea7854e05a18fe921d8fb3a5b/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:54.015733 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d36eb5-7ae9-43f5-b452-bc8fb4452e1f admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.026102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.026413 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.026716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.039200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1385/2759] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:53 2022] PUT /identity/v3/projects/5dbe1107329e42d4a5b58143434e2e5c/users/2b5749eb3af343e7b6bfafc68883c3ac/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:54.050028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd9a83-968e-4f5e-a692-315537f7e563 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.050344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd9a83-968e-4f5e-a692-315537f7e563 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.050621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd9a83-968e-4f5e-a692-315537f7e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.079510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] MFA Rules not processed for user `0ef4ddfea7854e05a18fe921d8fb3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:54.080157 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:54.096486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-bfdd9a83-968e-4f5e-a692-315537f7e563 None None] MFA Rules not processed for user `2b5749eb3af343e7b6bfafc68883c3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:54.105245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-bfdd9a83-968e-4f5e-a692-315537f7e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:54.201401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1375/2760] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:54.212734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.214794 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:54.218431 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1386/2761] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:25:54.223156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd9a83-968e-4f5e-a692-315537f7e563 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.281243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23432dff-b8ac-4c26-a2fc-697b4c4effd1 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.286883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.287534 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.287798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.288068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.298924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.300497 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.310224 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd9a83-968e-4f5e-a692-315537f7e563 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.318123 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.318931 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.319302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.321230 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.322473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.324544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1376/2762] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:54.325429 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.374014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:54.388082 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1387/2763] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:54 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:54.388822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.404065 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d620228-961c-4e31-bc75-43bfeac0f2a0 service cinder] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.448432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.525829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.526651 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.526924 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.527213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.527814 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.530698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.560882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1377/2764] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:54 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:54.563400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.576297 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a204b0-7c05-4bcb-b77b-6c0f26f1c674 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.591500 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57585180-1db5-4c65-9569-f298aba0b3ef admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.597519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.598166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.598508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.598743 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.599444 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.602594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.603877 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.604605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.605018 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.605285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.621345 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:54.638054 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1378/2765] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:54.642674 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.664525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1179f-0796-44cb-9df6-b1babbb802a0 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.678669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.679386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.682399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.682746 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] PATH_INFO: `/v3/projects/86a6acddd50e4f578cf7eaaae03c1aa2/users/452fb1d87c8e473fa3cf8b93c6e9cd2e/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.719589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.721268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.729233 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a6acddd50e4f578cf7eaaae03c1aa2, user_id=452fb1d87c8e473fa3cf8b93c6e9cd2e, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.732643 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.733102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1388/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:25:54.753460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1379/2767] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:54 2022] PUT /identity/v3/projects/86a6acddd50e4f578cf7eaaae03c1aa2/users/452fb1d87c8e473fa3cf8b93c6e9cd2e/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:54.758394 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.779291 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca2f3-5ab9-4e61-83e3-4a8a12b1c2ec service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.893614 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c631427-4075-404d-9157-ecca06a005bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.894299 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c631427-4075-404d-9157-ecca06a005bb admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.894557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c631427-4075-404d-9157-ecca06a005bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.894875 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c631427-4075-404d-9157-ecca06a005bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.895578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c631427-4075-404d-9157-ecca06a005bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.897345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c631427-4075-404d-9157-ecca06a005bb admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:54.915127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1389/2768] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:54.919923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:54.939631 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07252b2-e5ab-421c-a3d3-f57e86d9131d admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:54.957933 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:54.958829 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:54.958986 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:54.959258 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] PATH_INFO: `/v3/projects/86a6acddd50e4f578cf7eaaae03c1aa2/users/452fb1d87c8e473fa3cf8b93c6e9cd2e/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:54.967551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a6acddd50e4f578cf7eaaae03c1aa2, user_id=452fb1d87c8e473fa3cf8b93c6e9cd2e, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:54.976106 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:55.009595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1380/2769] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:54 2022] PUT /identity/v3/projects/86a6acddd50e4f578cf7eaaae03c1aa2/users/452fb1d87c8e473fa3cf8b93c6e9cd2e/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:55.012494 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec649ea-22e2-46a8-91b1-3edabf7342f8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.012783 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec649ea-22e2-46a8-91b1-3edabf7342f8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.013147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec649ea-22e2-46a8-91b1-3edabf7342f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.056095 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-1ec649ea-22e2-46a8-91b1-3edabf7342f8 None None] MFA Rules not processed for user `452fb1d87c8e473fa3cf8b93c6e9cd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:55.058050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1ec649ea-22e2-46a8-91b1-3edabf7342f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:55.122784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:55.140916 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:55.183905 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1390/2770] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:55.211967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec649ea-22e2-46a8-91b1-3edabf7342f8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:55.229138 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527e49-7530-4eab-a75f-185c67dddc34 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:55.241197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:55.241873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.242742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.243022 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] PATH_INFO: `/v3/users/7475e7349e004cc5b5d58fa57b0118cd` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.246494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7475e7349e004cc5b5d58fa57b0118cd)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:55.251603 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:55.331243 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7475e7349e004cc5b5d58fa57b0118cd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:55.332175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7475e7349e004cc5b5d58fa57b0118cd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:55.349276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7475e7349e004cc5b5d58fa57b0118cd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:55.350118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7475e7349e004cc5b5d58fa57b0118cd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:55.355345 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec649ea-22e2-46a8-91b1-3edabf7342f8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:55.361621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c199074-0942-4cad-b8cc-85af91c4355c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:55.362313 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199074-0942-4cad-b8cc-85af91c4355c service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.362572 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199074-0942-4cad-b8cc-85af91c4355c service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.362838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199074-0942-4cad-b8cc-85af91c4355c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.365501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-4c199074-0942-4cad-b8cc-85af91c4355c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:55.384312 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-ff428783-eb77-4c37-95ae-6bd286f0f232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7475e7349e004cc5b5d58fa57b0118cd'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:55.405360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1381/2771] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:55 2022] DELETE /identity/v3/users/7475e7349e004cc5b5d58fa57b0118cd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:55.409535 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.411064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.413616 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.438626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:55.443652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:55.454257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c199074-0942-4cad-b8cc-85af91c4355c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:55.456176 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c199074-0942-4cad-b8cc-85af91c4355c service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:55.467625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1391/2772] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:55.540896 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:55.567053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1382/2773] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:55.579499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9883f-1e44-4b51-9c82-d29bcd7b2e66 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.579499 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9883f-1e44-4b51-9c82-d29bcd7b2e66 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.579693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9883f-1e44-4b51-9c82-d29bcd7b2e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.587400 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:55.590639 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:55.630846 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-12c9883f-1e44-4b51-9c82-d29bcd7b2e66 None None] MFA Rules not processed for user `879d69c60bdc4d049fb3e782fa17306a`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:55.632589 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-12c9883f-1e44-4b51-9c82-d29bcd7b2e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:55.673116 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b8110-c042-4392-adb5-8eeb89ed0d87 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:55.684094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:55.684812 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.685098 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.685566 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.700677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:55.702556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:55.732071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1383/2774] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:55.745342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1392/2775] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:55.749570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:55.750994 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:55.768606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43ca6-e603-40b8-8458-f601a260d519 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:55.774598 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:55.775296 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.775478 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.775751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.776438 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:55.778409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:55.816708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1384/2776] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:55 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:55.821451 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9883f-1e44-4b51-9c82-d29bcd7b2e66 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:55.839073 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9883f-1e44-4b51-9c82-d29bcd7b2e66 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:55.860918 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:55.967228 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:55.967883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:55.968153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:55.968417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:55.969086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:55.971050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:56.000732 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1393/2777] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:55 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:56.005190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:56.018418 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb3fb-e78c-4482-82ea-f750b5e358b8 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:56.024723 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:56.025277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:56.025521 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:56.025800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:56.027064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:56.029060 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:56.044260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1385/2778] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:56.048811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:56.060903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86c0f5-efd4-4de6-8cb8-beeeaf1678a9 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:56.065942 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:56.066689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:56.067054 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:56.067337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] PATH_INFO: `/v3/projects/aa1e8d8c08804ac8a0ff5bda43ed6b73/users/50e6f14405cd481290c45d533f780538/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:56.085222 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1e8d8c08804ac8a0ff5bda43ed6b73, user_id=50e6f14405cd481290c45d533f780538, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:56.088461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:56.104284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:56.106160 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:56.108263 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1394/2779] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:56 2022] PUT /identity/v3/projects/aa1e8d8c08804ac8a0ff5bda43ed6b73/users/50e6f14405cd481290c45d533f780538/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:56.111908 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:56.129858 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b7a82-585c-41d9-8fb4-ea958e050c0c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:56.188938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b0a25-ea5e-4820-9ac3-30c0b3eb9fa1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:56.193838 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:56.194493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:56.194767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:56.194895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:56.195032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:56.195517 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:56.195782 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:56.195967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:56.196071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] PATH_INFO: `/v3/projects/609c6478307c44cc8668de99e6ee0448` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:56.197221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609c6478307c44cc8668de99e6ee0448)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:56.197925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:56.199244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:56.211401 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1395/2780] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:56.212448 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:56.222439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d9d7e-4ca7-4489-a2c5-ecd8b4f2c781 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:56.227865 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:56.228520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:56.228815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:56.229088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] PATH_INFO: `/v3/projects/aa1e8d8c08804ac8a0ff5bda43ed6b73/users/50e6f14405cd481290c45d533f780538/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:56.231067 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1e8d8c08804ac8a0ff5bda43ed6b73, user_id=50e6f14405cd481290c45d533f780538, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:56.233827 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:56.245015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1396/2781] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:56 2022] PUT /identity/v3/projects/aa1e8d8c08804ac8a0ff5bda43ed6b73/users/50e6f14405cd481290c45d533f780538/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:56.250614 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609c6478307c44cc8668de99e6ee0448', 'request_id': 'req-c5578eda-4f1d-459a-a79a-afd67adbb091'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.257446 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609c6478307c44cc8668de99e6ee0448', 'request_id': 'req-c5578eda-4f1d-459a-a79a-afd67adbb091'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.258766 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:56.264462 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609c6478307c44cc8668de99e6ee0448', 'request_id': 'req-c5578eda-4f1d-459a-a79a-afd67adbb091'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.279483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] The token cache is being invalidate because project 609c6478307c44cc8668de99e6ee0448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:56.279870 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.280596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.282221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1386/2782] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:56 2022] DELETE /identity/v3/projects/609c6478307c44cc8668de99e6ee0448 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:56.286702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:56.288458 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:56.359907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8c78-18cc-49bd-8b0b-8e4fed9ed41c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:56.364569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:56.365298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:56.365640 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:56.366003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] PATH_INFO: `/v3/users/0ef4ddfea7854e05a18fe921d8fb3a5b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:56.367843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef4ddfea7854e05a18fe921d8fb3a5b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:56.369809 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:56.380257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:56.418495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef4ddfea7854e05a18fe921d8fb3a5b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.419386 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef4ddfea7854e05a18fe921d8fb3a5b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.428539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef4ddfea7854e05a18fe921d8fb3a5b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.437841 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef4ddfea7854e05a18fe921d8fb3a5b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.449805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-c9c80dfa-4723-4fc8-bd47-ccd13242d866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef4ddfea7854e05a18fe921d8fb3a5b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:56.465478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1397/2783] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:56 2022] DELETE /identity/v3/users/0ef4ddfea7854e05a18fe921d8fb3a5b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:56.880068 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:56.975364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5578eda-4f1d-459a-a79a-afd67adbb091 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.067613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:57.068276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.068559 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.068836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] PATH_INFO: `/v3/projects/ab30a7dea9bd48b1b7a456226d35e515` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.070070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab30a7dea9bd48b1b7a456226d35e515)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:57.073562 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:57.151137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab30a7dea9bd48b1b7a456226d35e515', 'request_id': 'req-dd06b123-6891-4822-8528-bc674db61a7e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:57.159057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab30a7dea9bd48b1b7a456226d35e515', 'request_id': 'req-dd06b123-6891-4822-8528-bc674db61a7e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:57.168308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab30a7dea9bd48b1b7a456226d35e515', 'request_id': 'req-dd06b123-6891-4822-8528-bc674db61a7e'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:57.196414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] The token cache is being invalidate because project ab30a7dea9bd48b1b7a456226d35e515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:57.196787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:57.197786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-dd06b123-6891-4822-8528-bc674db61a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:57.202285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1387/2784] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:56 2022] DELETE /identity/v3/projects/ab30a7dea9bd48b1b7a456226d35e515 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:57.204529 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520802-2d20-4caa-a0ef-377d10dd4c95 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.204883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520802-2d20-4caa-a0ef-377d10dd4c95 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.205217 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520802-2d20-4caa-a0ef-377d10dd4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.228987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-64520802-2d20-4caa-a0ef-377d10dd4c95 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:57.230759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-64520802-2d20-4caa-a0ef-377d10dd4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:57.309258 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1398/2785] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:57.317918 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250aea9-9c95-4341-a8d8-2d378faab22d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.318261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250aea9-9c95-4341-a8d8-2d378faab22d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.318515 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250aea9-9c95-4341-a8d8-2d378faab22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.339838 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-4250aea9-9c95-4341-a8d8-2d378faab22d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:57.341094 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-4250aea9-9c95-4341-a8d8-2d378faab22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:57.350429 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1388/2786] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:57.354608 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520802-2d20-4caa-a0ef-377d10dd4c95 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:57.365687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520802-2d20-4caa-a0ef-377d10dd4c95 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.372021 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:57.372881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.373003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.373214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.374802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:25:57.374802 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:57.376322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:57.391402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1399/2787] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:25:57.396277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250aea9-9c95-4341-a8d8-2d378faab22d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:57.408637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250aea9-9c95-4341-a8d8-2d378faab22d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.415323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:57.415982 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.416404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.416675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.417378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:57.419362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:57.433269 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:57.461608 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1389/2788] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:57 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:57.462993 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:57.474558 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608a766-8d91-4693-a61c-12088554f24c admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.553036 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:57.553670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.554260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.554380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.555167 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:57.557933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:57.583459 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1400/2789] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:57 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:57.588266 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:57.602213 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831ea8d-2cc2-42b8-983f-53aa9badb082 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.607703 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:57.609074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.609074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.609074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.609693 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:57.611451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:57.625807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1390/2790] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:57.627539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:57.635090 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:57.640433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca5d5e-294e-45f8-89c5-1d870ffc15e1 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.650726 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879cb95-b79a-4e14-8b63-69e0825252e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:57.651402 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879cb95-b79a-4e14-8b63-69e0825252e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.652016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879cb95-b79a-4e14-8b63-69e0825252e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.652898 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879cb95-b79a-4e14-8b63-69e0825252e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.654025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879cb95-b79a-4e14-8b63-69e0825252e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:57.655393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879cb95-b79a-4e14-8b63-69e0825252e4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:57.673279 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1401/2791] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:25:57.674710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:57.688642 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e35ee2-ba96-4588-8680-120775b245b9 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.693564 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:57.694370 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.694751 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.695287 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] PATH_INFO: `/v3/projects/22efa7b3f3564ad3b13f01b99f30f17b/users/89bf538617ac496898fbe983ed57f19b/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.712719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22efa7b3f3564ad3b13f01b99f30f17b, user_id=89bf538617ac496898fbe983ed57f19b, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:57.716510 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:57.735875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1391/2792] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:57 2022] PUT /identity/v3/projects/22efa7b3f3564ad3b13f01b99f30f17b/users/89bf538617ac496898fbe983ed57f19b/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:57.737649 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:57.737868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:57.738129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:57.760953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:57.762268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:57.835702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1402/2793] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:57.909985 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:57.912199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:57.994617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311b08d-adf1-43ff-8e23-fb3b4696765c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:57.999250 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9e9c6-3623-44a5-bcbb-d197362cbb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:58.000147 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e9c6-3623-44a5-bcbb-d197362cbb4d service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:58.000436 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e9c6-3623-44a5-bcbb-d197362cbb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:58.000821 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e9c6-3623-44a5-bcbb-d197362cbb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:58.013977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9e9c6-3623-44a5-bcbb-d197362cbb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:58.015845 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9e9c6-3623-44a5-bcbb-d197362cbb4d service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:58.028070 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1392/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:58.318763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:58.321661 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:58.348553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7524ba2-82cd-4c18-bad6-7acef495f483 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:58.357907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:58.358650 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:58.358937 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:58.359215 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] PATH_INFO: `/v3/users/2b5749eb3af343e7b6bfafc68883c3ac` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:58.360966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5749eb3af343e7b6bfafc68883c3ac)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:58.362964 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:58.464337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5749eb3af343e7b6bfafc68883c3ac'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:58.465696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5749eb3af343e7b6bfafc68883c3ac'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:58.482974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5749eb3af343e7b6bfafc68883c3ac'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:58.512364 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5749eb3af343e7b6bfafc68883c3ac'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:58.548699 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5749eb3af343e7b6bfafc68883c3ac'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:58.563307 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1403/2795] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:58 2022] DELETE /identity/v3/users/2b5749eb3af343e7b6bfafc68883c3ac => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:25:58.567949 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bddbd-60e9-4868-9b3e-c982b5776ff1 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:58.568362 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bddbd-60e9-4868-9b3e-c982b5776ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:58.568759 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bddbd-60e9-4868-9b3e-c982b5776ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:58.608123 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-228bddbd-60e9-4868-9b3e-c982b5776ff1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:58.609708 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-228bddbd-60e9-4868-9b3e-c982b5776ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:58.769074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1393/2796] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:58.791443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:58.793367 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:58.924555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eec8d7-058d-433e-b4e9-a389c4f7e531 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:58.932752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:58.934480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:58.935231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:58.936003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:58.951911 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:58.954108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:58.966379 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1404/2797] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:25:59.073335 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56dbb-89d9-4599-9903-06529cbb0b62 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:59.073859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56dbb-89d9-4599-9903-06529cbb0b62 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:59.073859 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56dbb-89d9-4599-9903-06529cbb0b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:59.120318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-bad56dbb-89d9-4599-9903-06529cbb0b62 None None] MFA Rules not processed for user `89bf538617ac496898fbe983ed57f19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:25:59.121802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-bad56dbb-89d9-4599-9903-06529cbb0b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:59.187796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:59.210285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1394/2798] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:25:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:25:59.214214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:59.215752 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:59.237708 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc3ab-446f-4396-babf-ab34ae62c431 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:59.256220 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:59.257143 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:59.257425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:59.258668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:59.258947 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:59.264677 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:59.272940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:25:59.394391 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56dbb-89d9-4599-9903-06529cbb0b62 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:59.394605 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1405/2799] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:25:59 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:25:59.417110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56dbb-89d9-4599-9903-06529cbb0b62 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:59.505789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:59.508621 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:59.555503 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:59.556156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:59.557193 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:59.557483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:59.558183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:59.571046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:59.613874 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1395/2800] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:25:59 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:25:59.618624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:59.644129 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b9962-4e85-4a06-af07-0c31b397501e admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:59.652993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866718-5450-4e90-8023-add77022e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:59.654201 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866718-5450-4e90-8023-add77022e993 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:59.654539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866718-5450-4e90-8023-add77022e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:59.654802 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866718-5450-4e90-8023-add77022e993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:59.655530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866718-5450-4e90-8023-add77022e993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:59.657508 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866718-5450-4e90-8023-add77022e993 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:59.688836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1396/2801] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:25:59.691591 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866718-5450-4e90-8023-add77022e993 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:59.706002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc45c-017f-4e89-922c-d16e252b0eae admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:59.713751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:59.714933 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:59.715560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:59.716044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] PATH_INFO: `/v3/projects/5dbe1107329e42d4a5b58143434e2e5c` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:59.717735 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbe1107329e42d4a5b58143434e2e5c)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:59.720639 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:59.722617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866718-5450-4e90-8023-add77022e993 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:59.735344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:59.736046 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:59.736332 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:59.736612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] PATH_INFO: `/v3/projects/2b9d493f1665436e906eb699b7234aaf/users/f8d9d2ff06a248bb9441bf033872a41f/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:59.766915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9d493f1665436e906eb699b7234aaf, user_id=f8d9d2ff06a248bb9441bf033872a41f, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:59.780864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:59.809744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbe1107329e42d4a5b58143434e2e5c', 'request_id': 'req-8a51723d-02ee-42b6-b6dd-9896ad1b23da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:59.813124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1397/2802] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:59 2022] PUT /identity/v3/projects/2b9d493f1665436e906eb699b7234aaf/users/f8d9d2ff06a248bb9441bf033872a41f/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:59.814499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:59.837910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbe1107329e42d4a5b58143434e2e5c', 'request_id': 'req-8a51723d-02ee-42b6-b6dd-9896ad1b23da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:59.846896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbe1107329e42d4a5b58143434e2e5c', 'request_id': 'req-8a51723d-02ee-42b6-b6dd-9896ad1b23da'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:59.876506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] The token cache is being invalidate because project 5dbe1107329e42d4a5b58143434e2e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:25:59.877323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:59.878940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:25:59.889412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1406/2803] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:25:59 2022] DELETE /identity/v3/projects/5dbe1107329e42d4a5b58143434e2e5c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:25:59.891385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:25:59.894976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:25:59.955337 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847a71-3e44-490b-bde0-80c430433406 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:25:59.976368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:25:59.977789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:25:59.978265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:25:59.979047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:25:59.980585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:25:59.982466 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:25:59.999653 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1398/2804] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:00.000993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:00.003244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:00.023556 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95497d3-16d9-42a1-a30f-45d39b6f3089 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:00.038437 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:00.040280 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] REQUEST_METHOD: `PUT` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:00.041798 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:00.042260 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] PATH_INFO: `/v3/projects/2b9d493f1665436e906eb699b7234aaf/users/f8d9d2ff06a248bb9441bf033872a41f/roles/5060abf6b18b41ad8d29655dc41e0007` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:00.046161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9d493f1665436e906eb699b7234aaf, user_id=f8d9d2ff06a248bb9441bf033872a41f, role_id=5060abf6b18b41ad8d29655dc41e0007)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:00.051006 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51723d-02ee-42b6-b6dd-9896ad1b23da admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:00.052385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:00.061793 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:00.062963 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:00.063953 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:00.064703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] PATH_INFO: `/v3/users/452fb1d87c8e473fa3cf8b93c6e9cd2e` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:00.067702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452fb1d87c8e473fa3cf8b93c6e9cd2e)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:00.071407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:00.079969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1399/2805] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:25:59 2022] PUT /identity/v3/projects/2b9d493f1665436e906eb699b7234aaf/users/f8d9d2ff06a248bb9441bf033872a41f/roles/5060abf6b18b41ad8d29655dc41e0007 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:00.120020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:00.169147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452fb1d87c8e473fa3cf8b93c6e9cd2e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:00.170492 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452fb1d87c8e473fa3cf8b93c6e9cd2e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:00.181734 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452fb1d87c8e473fa3cf8b93c6e9cd2e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:00.194716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452fb1d87c8e473fa3cf8b93c6e9cd2e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:00.232250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-b62cdf9b-228b-4245-8161-8b0f69598ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452fb1d87c8e473fa3cf8b93c6e9cd2e'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:00.241202 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1407/2806] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:25:59 2022] DELETE /identity/v3/users/452fb1d87c8e473fa3cf8b93c6e9cd2e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:01.174188 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:01.182477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:01.296970 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:01.363815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c295d0-049a-4800-a05c-3deb2f67a14c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:01.504172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:01.504850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:01.505137 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:01.505417 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] PATH_INFO: `/v3/projects/86a6acddd50e4f578cf7eaaae03c1aa2` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:01.507058 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a6acddd50e4f578cf7eaaae03c1aa2)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:01.515872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:01.656613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a6acddd50e4f578cf7eaaae03c1aa2', 'request_id': 'req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:01.673694 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a6acddd50e4f578cf7eaaae03c1aa2', 'request_id': 'req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:01.689402 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a6acddd50e4f578cf7eaaae03c1aa2', 'request_id': 'req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:01.713777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] The token cache is being invalidate because project 86a6acddd50e4f578cf7eaaae03c1aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:26:01.714073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:01.714779 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-93fdfdc1-b85f-44e4-9708-fe6fc082fb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:01.716310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1400/2807] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:01 2022] DELETE /identity/v3/projects/86a6acddd50e4f578cf7eaaae03c1aa2 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:01.723559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899cae-bf48-44b0-bcdb-a8258063cda2 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:01.724138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899cae-bf48-44b0-bcdb-a8258063cda2 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:01.724138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899cae-bf48-44b0-bcdb-a8258063cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:01.751689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-f0899cae-bf48-44b0-bcdb-a8258063cda2 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:01.753285 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0899cae-bf48-44b0-bcdb-a8258063cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:01.889417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1408/2808] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:01.897512 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a83d1-0bf2-467f-b408-f3f501fcff14 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:01.897852 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a83d1-0bf2-467f-b408-f3f501fcff14 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:01.898100 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a83d1-0bf2-467f-b408-f3f501fcff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:01.924330 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-064a83d1-0bf2-467f-b408-f3f501fcff14 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:01.925502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-064a83d1-0bf2-467f-b408-f3f501fcff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:01.939170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899cae-bf48-44b0-bcdb-a8258063cda2 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:01.939726 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1401/2809] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:01.952032 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899cae-bf48-44b0-bcdb-a8258063cda2 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:01.960407 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:01.961903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:01.964120 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:01.969102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:01.970161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:26:01.970687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:01.972522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:02.002989 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a83d1-0bf2-467f-b408-f3f501fcff14 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:02.009165 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1409/2810] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:26:02.017047 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a83d1-0bf2-467f-b408-f3f501fcff14 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:02.031082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:02.031734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.032013 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.032285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] PATH_INFO: `/v3/projects` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.032967 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:02.034965 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:02.080472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1402/2811] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:26:02 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:26:02.084680 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:02.096819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cf2d3-6cd5-4ce4-b378-e5ad96a55822 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:02.177925 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:02.178584 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.178879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.179148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] PATH_INFO: `/v3/users` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.179872 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:02.181884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:02.209780 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1410/2812] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:26:02 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:26:02.214620 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:02.236628 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef919c-c4e2-4c31-a3e7-638ac202e003 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:02.249005 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5d6bf-2f55-4f0b-a671-ca6125304977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:02.250281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d6bf-2f55-4f0b-a671-ca6125304977 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.250791 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d6bf-2f55-4f0b-a671-ca6125304977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.251179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d6bf-2f55-4f0b-a671-ca6125304977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.252221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5d6bf-2f55-4f0b-a671-ca6125304977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:02.254637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5d6bf-2f55-4f0b-a671-ca6125304977 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:02.272532 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:02.280999 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1403/2813] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:02.285903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6d4e-e560-4939-9290-30ffec615bca admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:02.291559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:02.292555 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.292940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.294133 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.295004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:02.296897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:02.313902 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35c46-41fe-4f94-adf2-1f3304fad775 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.314470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35c46-41fe-4f94-adf2-1f3304fad775 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.314966 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35c46-41fe-4f94-adf2-1f3304fad775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.348789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1411/2814] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:26:02.352015 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:02.361163 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:02.376939 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b235c-dfad-4cfe-8496-5e8d7f90c3a4 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:02.386576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-39c35c46-41fe-4f94-adf2-1f3304fad775 None None] MFA Rules not processed for user `f8d9d2ff06a248bb9441bf033872a41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:02.388498 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-39c35c46-41fe-4f94-adf2-1f3304fad775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:02.391642 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e93ec-4252-4341-8a18-8a3503a736ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:02.392347 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e93ec-4252-4341-8a18-8a3503a736ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.392632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e93ec-4252-4341-8a18-8a3503a736ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.392909 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e93ec-4252-4341-8a18-8a3503a736ae admin admin] PATH_INFO: `/v3/projects/171e569b9bdd426c889c274472d46cf0/users/140f9b797a004778bc4784486d587a8f/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.407881 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:02.427272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e93ec-4252-4341-8a18-8a3503a736ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=171e569b9bdd426c889c274472d46cf0, user_id=140f9b797a004778bc4784486d587a8f, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:02.438405 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e93ec-4252-4341-8a18-8a3503a736ae admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:02.465805 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1412/2815] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:26:02 2022] PUT /identity/v3/projects/171e569b9bdd426c889c274472d46cf0/users/140f9b797a004778bc4784486d587a8f/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:02.546138 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.546520 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.546803 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.580366 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1404/2816] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:02.597061 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.597656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.597656 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.624759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] MFA Rules not processed for user `140f9b797a004778bc4784486d587a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:02.628329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] MFA Rules not processed for user `89bf538617ac496898fbe983ed57f19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:02.629530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:02.632711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:02.749193 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1413/2817] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:26:02.762151 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1405/2818] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:02.762772 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:02.764198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:02.784576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:02.786957 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:02.896328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2af89d-5e81-4a56-8b56-0437ab803155 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:02.905447 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accce2c3-2278-47b4-b25e-6543cecac092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:02.906092 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accce2c3-2278-47b4-b25e-6543cecac092 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.906409 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accce2c3-2278-47b4-b25e-6543cecac092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.906703 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accce2c3-2278-47b4-b25e-6543cecac092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.922268 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accce2c3-2278-47b4-b25e-6543cecac092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:02.923817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accce2c3-2278-47b4-b25e-6543cecac092 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:02.941102 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1414/2819] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:02.944748 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f314e-bacd-408d-9e5f-689f611af972 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:02.963548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:02.963548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.963548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.963548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.965306 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:02.965665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:02.966013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:02.968971 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:02.986407 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:02.988648 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:03.016114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1406/2820] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:03.024683 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] MFA Rules not processed for user `50e6f14405cd481290c45d533f780538`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:03.026009 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:03.057404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:03.059721 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:03.112716 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:03.123268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:03.128658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1415/2821] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:03.140115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816c2af-c6cf-4344-9f54-bc7ea96df846 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:03.144699 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2718132c4914dbda4582e259eccbaef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:03.145644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:03.146066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:03.146189 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:03.146741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:03.147812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:03.149538 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:03.171214 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902dc86-0d5f-42e6-a67e-4e2dd8df42bd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:03.176919 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:03.178384 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea763013-a1ae-426d-b2ba-84b1839adc50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:03.179184 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763013-a1ae-426d-b2ba-84b1839adc50 service nova] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:03.179334 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:03.180005 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763013-a1ae-426d-b2ba-84b1839adc50 service nova] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:03.180168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763013-a1ae-426d-b2ba-84b1839adc50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:03.182013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-ea763013-a1ae-426d-b2ba-84b1839adc50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:03.206382 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1407/2822] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:03.266548 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea763013-a1ae-426d-b2ba-84b1839adc50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:03.268412 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea763013-a1ae-426d-b2ba-84b1839adc50 service nova] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:03.280647 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1416/2823] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:26:03.863945 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:03.866139 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:03.954851 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6a9a-a6cf-4fb9-91ce-4435801ebbbf service glance] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:03.962704 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8443ed-107e-4e36-ae16-c552cfe311c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:03.964256 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8443ed-107e-4e36-ae16-c552cfe311c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:03.964750 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8443ed-107e-4e36-ae16-c552cfe311c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:03.965185 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8443ed-107e-4e36-ae16-c552cfe311c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:03.967840 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-ba8443ed-107e-4e36-ae16-c552cfe311c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:04.006291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8443ed-107e-4e36-ae16-c552cfe311c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:04.008143 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8443ed-107e-4e36-ae16-c552cfe311c8 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:04.028804 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1408/2824] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:04.535432 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:04.536393 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:04.536843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:04.537905 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b187d-5555-4c57-92fd-9862425b9dbe None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:04.538612 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b187d-5555-4c57-92fd-9862425b9dbe None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:04.538796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b187d-5555-4c57-92fd-9862425b9dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:04.566539 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] MFA Rules not processed for user `140f9b797a004778bc4784486d587a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:04.575001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:04.588326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1417/2825] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:04.717680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-853b187d-5555-4c57-92fd-9862425b9dbe None None] MFA Rules not processed for user `879d69c60bdc4d049fb3e782fa17306a`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:04.719082 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-853b187d-5555-4c57-92fd-9862425b9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:04.726777 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1409/2826] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:26:14.556016 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=37 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:14.557946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=33 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:19.313849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:19.315476 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:19.327742 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5b970-7c42-4a52-ad03-39414232ec64 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:19.331844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:19.332550 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:19.332835 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:19.333105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:19.393210 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:19.394698 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:19.404181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1418/2827] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:25.770360 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdf1ac-185f-4b40-bfee-37d060fd62ec None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:25.770915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdf1ac-185f-4b40-bfee-37d060fd62ec None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:25.770915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdf1ac-185f-4b40-bfee-37d060fd62ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:25.835175 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d7fdf1ac-185f-4b40-bfee-37d060fd62ec None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:25.837089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d7fdf1ac-185f-4b40-bfee-37d060fd62ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:25.904500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1410/2828] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:26:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:25.951609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:25.953781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:26.060910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774e3b-ad96-48a8-9c79-58b538b1ae78 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:26.067576 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:26.067759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:26.067974 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:26.068248 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:26.079540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:26.081127 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:26.092168 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1419/2829] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:26:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:26:26.707654 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0e22-ad5d-4ced-945d-a03e0aafb64c None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:26.708023 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0e22-ad5d-4ced-945d-a03e0aafb64c None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:26.708227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0e22-ad5d-4ced-945d-a03e0aafb64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:26.744265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-e75e0e22-ad5d-4ced-945d-a03e0aafb64c None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:26.746712 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e75e0e22-ad5d-4ced-945d-a03e0aafb64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:26.764192 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1411/2830] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 28 22:26:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:26.786183 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:26.803682 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ba1f-759f-4f0d-91e8-00cdaf0ada0f service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:26.811380 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:26.812296 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:26.812543 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:26.812808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:26.823430 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:26.827153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:26.852479 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1420/2831] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:26:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:26:27.158390 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90245d1-02c7-48d9-8c9c-b1cdf4c06e15 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:27.158866 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90245d1-02c7-48d9-8c9c-b1cdf4c06e15 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:27.159313 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90245d1-02c7-48d9-8c9c-b1cdf4c06e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:27.181456 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d90245d1-02c7-48d9-8c9c-b1cdf4c06e15 None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:27.182978 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d90245d1-02c7-48d9-8c9c-b1cdf4c06e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:27.192392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1412/2832] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 28 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:27.204610 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:27.216354 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e810286-77e5-452c-a06b-bef6916fadf9 service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:27.223157 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:27.224087 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:27.224365 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:27.224635 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:27.235320 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:27.236904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:27.247609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1421/2833] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:26:27.591452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726321-de2e-4d44-b57d-e272f300de6d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:27.591783 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726321-de2e-4d44-b57d-e272f300de6d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:27.592056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726321-de2e-4d44-b57d-e272f300de6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:27.611764 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-20726321-de2e-4d44-b57d-e272f300de6d None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:27.612897 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-20726321-de2e-4d44-b57d-e272f300de6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:27.621186 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1413/2834] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 28 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:26:27.635223 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:27.645897 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d51e2-7101-4027-992b-f4814bbec9ee service swift] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:27.651744 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11294c12-eaa1-49f0-bde4-3d27b9672e3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:27.652346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11294c12-eaa1-49f0-bde4-3d27b9672e3e service swift] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:27.652628 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11294c12-eaa1-49f0-bde4-3d27b9672e3e service swift] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:27.652903 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11294c12-eaa1-49f0-bde4-3d27b9672e3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:27.660912 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11294c12-eaa1-49f0-bde4-3d27b9672e3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:27.662495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11294c12-eaa1-49f0-bde4-3d27b9672e3e service swift] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:27.670389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1422/2835] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:26:29.783460 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20726321-de2e-4d44-b57d-e272f300de6d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:29.848135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20726321-de2e-4d44-b57d-e272f300de6d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:29.853216 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:29.853872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:29.854149 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:29.854675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] PATH_INFO: `/v3/users/140f9b797a004778bc4784486d587a8f` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:29.855883 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] RBAC: Authorizing `identity:delete_user(user_id=140f9b797a004778bc4784486d587a8f)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:29.857899 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:29.911647 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140f9b797a004778bc4784486d587a8f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:29.912300 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140f9b797a004778bc4784486d587a8f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:29.918655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:29.920939 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140f9b797a004778bc4784486d587a8f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:29.921843 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140f9b797a004778bc4784486d587a8f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:29.934915 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140f9b797a004778bc4784486d587a8f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:29.947677 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1414/2836] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:26:29 2022] DELETE /identity/v3/users/140f9b797a004778bc4784486d587a8f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:29.952208 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:29.952643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:29.952763 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:29.971375 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:29.972566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:29.991255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=100 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:30.032468 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1423/2837] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:30.042832 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.044346 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:30.103199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9842-0c9d-491c-aba3-7eb3f228848a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.107027 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a52e-e8a8-4d5a-8104-ff2160d00e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.107716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a52e-e8a8-4d5a-8104-ff2160d00e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.108059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a52e-e8a8-4d5a-8104-ff2160d00e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.108394 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a52e-e8a8-4d5a-8104-ff2160d00e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.118871 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a52e-e8a8-4d5a-8104-ff2160d00e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.120469 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a52e-e8a8-4d5a-8104-ff2160d00e4a service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.130736 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1415/2838] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:30.315955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.317504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:30.335461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c37288-9eda-4bd5-bc1c-6db519a912cb None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.341406 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.342141 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.342514 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.343035 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] PATH_INFO: `/v3/projects/171e569b9bdd426c889c274472d46cf0` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.344326 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=171e569b9bdd426c889c274472d46cf0)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.346363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.400382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171e569b9bdd426c889c274472d46cf0', 'request_id': 'req-57c7a035-7d85-4010-a324-c2fd63e3a51b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:30.408069 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171e569b9bdd426c889c274472d46cf0', 'request_id': 'req-57c7a035-7d85-4010-a324-c2fd63e3a51b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:30.414982 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171e569b9bdd426c889c274472d46cf0', 'request_id': 'req-57c7a035-7d85-4010-a324-c2fd63e3a51b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:30.426955 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] The token cache is being invalidate because project 171e569b9bdd426c889c274472d46cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:26:30.427245 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:30.428000 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-57c7a035-7d85-4010-a324-c2fd63e3a51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:30.429654 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1424/2839] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:30 2022] DELETE /identity/v3/projects/171e569b9bdd426c889c274472d46cf0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:30.434583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee43325-3c2f-43c4-85db-589da8b958e9 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.435118 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee43325-3c2f-43c4-85db-589da8b958e9 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.435588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee43325-3c2f-43c4-85db-589da8b958e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.455031 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9ee43325-3c2f-43c4-85db-589da8b958e9 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:30.456237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9ee43325-3c2f-43c4-85db-589da8b958e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:30.518271 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1416/2840] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:30.527363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ea6bc-585b-46ba-b6e1-7b7a9be14cb7 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.527638 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ea6bc-585b-46ba-b6e1-7b7a9be14cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.527901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ea6bc-585b-46ba-b6e1-7b7a9be14cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.548518 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-3d6ea6bc-585b-46ba-b6e1-7b7a9be14cb7 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:30.549981 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3d6ea6bc-585b-46ba-b6e1-7b7a9be14cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:30.559969 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1425/2841] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:30.564173 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee43325-3c2f-43c4-85db-589da8b958e9 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.574489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee43325-3c2f-43c4-85db-589da8b958e9 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.579412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.580030 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.580329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.580602 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.581315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:26:30.581613 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.583218 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.599452 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1417/2842] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:26:30.600559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ea6bc-585b-46ba-b6e1-7b7a9be14cb7 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.610003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ea6bc-585b-46ba-b6e1-7b7a9be14cb7 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.614631 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.615231 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.615506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.615773 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.616510 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.618544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.650495 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1426/2843] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:26:30 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:26:30.651825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.662037 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d45b-af2d-4c42-896e-e9d8934d3bd1 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.719208 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.719825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.720102 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.720372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.721053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.732111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.732111 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:30.749276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1418/2844] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:26:30 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:26:30.753967 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.765182 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d650a3-32d4-4510-a4a2-668588d38c90 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.775761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.776387 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.776658 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.776973 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.777672 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.779363 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.790689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1427/2845] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:30.795409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.808285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d87b7-57da-4236-a4d6-3dcd43cd837c admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.814667 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c06f68-f8ab-4683-87be-ba930a7b7ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.815307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06f68-f8ab-4683-87be-ba930a7b7ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.815585 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06f68-f8ab-4683-87be-ba930a7b7ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.815854 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06f68-f8ab-4683-87be-ba930a7b7ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.816555 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c06f68-f8ab-4683-87be-ba930a7b7ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.818284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c06f68-f8ab-4683-87be-ba930a7b7ce8 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.830806 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1419/2846] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:30.835668 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:30.856030 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784da7-6305-49fb-b021-4a554a68d133 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:30.870099 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:30.870722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.871002 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.871276 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] PATH_INFO: `/v3/projects/202e9e983c7a441da98ee48c83e83ff7/users/e1e61484c23b43679179aa48e29207e5/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.889277 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202e9e983c7a441da98ee48c83e83ff7, user_id=e1e61484c23b43679179aa48e29207e5, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:30.892181 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:30.907722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1428/2847] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:26:30 2022] PUT /identity/v3/projects/202e9e983c7a441da98ee48c83e83ff7/users/e1e61484c23b43679179aa48e29207e5/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:30.921194 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:30.921506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:30.921880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:30.957771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] MFA Rules not processed for user `e1e61484c23b43679179aa48e29207e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:30.959310 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:31.031396 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1420/2848] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:31.042740 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:31.044689 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:31.097711 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:31.115150 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77693902-fc24-4e93-9817-9e11fda98760 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:31.119383 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:31.119997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:31.120352 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:31.120566 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:31.128871 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:31.130341 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:31.140881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1429/2849] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:26:34.658773 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:34.660364 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:34.724331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be6dc-3f96-4ee0-8005-f2cda4e9f760 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:34.727827 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:34.729002 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:34.729274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:34.729539 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:34.731318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:34.741303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:34.742596 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:34.750875 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1421/2850] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:37.701627 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:37.711022 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f998-7eb1-4662-b393-2b2d1d67e0e2 service cinder] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:37.714670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181475f2-6100-48a2-9a44-eeba014f4bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:37.715807 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181475f2-6100-48a2-9a44-eeba014f4bff service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:37.716088 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181475f2-6100-48a2-9a44-eeba014f4bff service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:37.716362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181475f2-6100-48a2-9a44-eeba014f4bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:37.718109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-181475f2-6100-48a2-9a44-eeba014f4bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:37.784395 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181475f2-6100-48a2-9a44-eeba014f4bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:37.786145 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181475f2-6100-48a2-9a44-eeba014f4bff service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:37.799509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1430/2851] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:41.216241 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:41.280673 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5f1a0-e6cc-4fe0-a1cd-7a7c6354f4e3 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:41.285161 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:41.285801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:41.286075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:41.286378 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] PATH_INFO: `/v3/users/e1e61484c23b43679179aa48e29207e5` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:41.287546 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e61484c23b43679179aa48e29207e5)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:41.289441 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:41.303301 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:41.336753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e61484c23b43679179aa48e29207e5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:41.337404 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e61484c23b43679179aa48e29207e5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:41.345049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e61484c23b43679179aa48e29207e5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:41.345768 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e61484c23b43679179aa48e29207e5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:41.358634 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e61484c23b43679179aa48e29207e5'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:41.373166 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1422/2852] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:26:41 2022] DELETE /identity/v3/users/e1e61484c23b43679179aa48e29207e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:41.377884 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:41.378425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:41.378538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:41.397359 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:41.398523 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:41.461926 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1431/2853] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 22:26:41.471835 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:41.473291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:41.532136 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230144-0fd6-4180-949d-8c8027d357d1 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:41.535867 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:41.536487 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:41.536822 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:41.537101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:41.547471 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:41.548943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:41.558786 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1423/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:41.955526 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:41.957114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:41.970050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5b2f9-b7ee-4e91-ad6e-4a40765bcb85 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:41.974636 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:41.975273 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:41.975549 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:41.975817 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] PATH_INFO: `/v3/projects/202e9e983c7a441da98ee48c83e83ff7` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:41.976957 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202e9e983c7a441da98ee48c83e83ff7)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:41.978874 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:42.040657 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202e9e983c7a441da98ee48c83e83ff7', 'request_id': 'req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.049521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202e9e983c7a441da98ee48c83e83ff7', 'request_id': 'req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.055632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202e9e983c7a441da98ee48c83e83ff7', 'request_id': 'req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.068751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] The token cache is being invalidate because project 202e9e983c7a441da98ee48c83e83ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:26:42.069039 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.069771 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.071346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1432/2855] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:41 2022] DELETE /identity/v3/projects/202e9e983c7a441da98ee48c83e83ff7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:42.376811 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:42.378268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:42.391770 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666a82d-ff3c-49b9-b5cf-ce464b6aade5 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:42.447440 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:42.448086 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:42.448368 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:42.448644 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] PATH_INFO: `/v3/users/89bf538617ac496898fbe983ed57f19b` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:42.450412 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bf538617ac496898fbe983ed57f19b)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:42.452329 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:42.490282 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:42.500431 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bf538617ac496898fbe983ed57f19b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.501384 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bf538617ac496898fbe983ed57f19b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.508454 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bf538617ac496898fbe983ed57f19b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.509074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bf538617ac496898fbe983ed57f19b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.521285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bf538617ac496898fbe983ed57f19b'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.534415 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1424/2856] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:26:42 2022] DELETE /identity/v3/users/89bf538617ac496898fbe983ed57f19b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:42.705173 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:42.706715 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:42.717417 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:42.721443 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d1b8-ca5a-4fb8-b340-ff2c260fc1a2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:42.782197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:42.782885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:42.783162 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:42.783427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] PATH_INFO: `/v3/projects/22efa7b3f3564ad3b13f01b99f30f17b` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:42.784704 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22efa7b3f3564ad3b13f01b99f30f17b)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:42.786952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:42.833674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22efa7b3f3564ad3b13f01b99f30f17b', 'request_id': 'req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.841728 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22efa7b3f3564ad3b13f01b99f30f17b', 'request_id': 'req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.847377 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22efa7b3f3564ad3b13f01b99f30f17b', 'request_id': 'req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.858820 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] The token cache is being invalidate because project 22efa7b3f3564ad3b13f01b99f30f17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:26:42.859108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.859751 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.861250 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1433/2857] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:42 2022] DELETE /identity/v3/projects/22efa7b3f3564ad3b13f01b99f30f17b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:42.865197 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:42.866627 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:42.879895 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aaa6a-844e-4f64-81b7-f71232e831b5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:42.936594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:42.937237 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:42.937520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:42.937796 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] PATH_INFO: `/v3/users/f8d9d2ff06a248bb9441bf033872a41f` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:42.938977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d9d2ff06a248bb9441bf033872a41f)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:42.940894 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:42.985816 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d9d2ff06a248bb9441bf033872a41f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.986439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d9d2ff06a248bb9441bf033872a41f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.994015 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d9d2ff06a248bb9441bf033872a41f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:42.994680 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d9d2ff06a248bb9441bf033872a41f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:43.006863 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d3635753-cc9a-420c-943d-0b3b722a317a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d9d2ff06a248bb9441bf033872a41f'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:43.021003 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1425/2858] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:26:42 2022] DELETE /identity/v3/users/f8d9d2ff06a248bb9441bf033872a41f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:43.194781 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.196240 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:43.210013 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45838-c6cb-48c8-bfde-faeb0ac810b2 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.267271 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.267849 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.268130 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.268404 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] PATH_INFO: `/v3/projects/2b9d493f1665436e906eb699b7234aaf` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.269557 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9d493f1665436e906eb699b7234aaf)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.271486 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.308362 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:43.319687 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9d493f1665436e906eb699b7234aaf', 'request_id': 'req-41e161d6-69d4-48ff-8857-bf2027d0db03'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:43.326722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9d493f1665436e906eb699b7234aaf', 'request_id': 'req-41e161d6-69d4-48ff-8857-bf2027d0db03'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:43.332178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9d493f1665436e906eb699b7234aaf', 'request_id': 'req-41e161d6-69d4-48ff-8857-bf2027d0db03'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:43.342843 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] The token cache is being invalidate because project 2b9d493f1665436e906eb699b7234aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:26:43.343131 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:43.343787 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-41e161d6-69d4-48ff-8857-bf2027d0db03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:43.345267 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1434/2859] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:43 2022] DELETE /identity/v3/projects/2b9d493f1665436e906eb699b7234aaf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:26:43.350411 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cfeab-fe42-4a89-a4f5-466901e1621d None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.350775 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cfeab-fe42-4a89-a4f5-466901e1621d None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.351062 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cfeab-fe42-4a89-a4f5-466901e1621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.372158 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-9f9cfeab-fe42-4a89-a4f5-466901e1621d None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:43.373392 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-9f9cfeab-fe42-4a89-a4f5-466901e1621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:43.401267 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:43.433747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1426/2860] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:43.441739 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37a76-d290-4cec-8436-657851a6b9c1 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.442028 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37a76-d290-4cec-8436-657851a6b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.442335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37a76-d290-4cec-8436-657851a6b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.461946 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-0bc37a76-d290-4cec-8436-657851a6b9c1 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:43.463241 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0bc37a76-d290-4cec-8436-657851a6b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:43.471129 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1435/2861] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:43.475289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cfeab-fe42-4a89-a4f5-466901e1621d None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.485705 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cfeab-fe42-4a89-a4f5-466901e1621d None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.490387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.490998 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.491277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.491547 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.492236 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:26:43.492540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.494128 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.506308 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1427/2862] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:26:43.510743 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc37a76-d290-4cec-8436-657851a6b9c1 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.520630 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc37a76-d290-4cec-8436-657851a6b9c1 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.526016 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.526670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.526952 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.527226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.527930 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.529951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.557670 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1436/2863] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:26:43 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:26:43.562637 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.572502 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1c07-1d2e-4635-8fbb-6d6a19f17e22 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.627463 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.628075 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.628357 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.628632 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.629284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.631228 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.652276 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1428/2864] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:26:43 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:26:43.657070 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.667196 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f0e0-310a-4998-8e46-c21c5f754978 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.672464 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.673065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.673346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.673619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.674331 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.675915 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.685979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1437/2865] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:43.689595 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.699576 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b3b5-89dd-45a1-a4fc-3b4e65882e46 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.704144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb12763-78c4-4d2d-beb8-f0cd211c3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.704747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12763-78c4-4d2d-beb8-f0cd211c3b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.705019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12763-78c4-4d2d-beb8-f0cd211c3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.705288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb12763-78c4-4d2d-beb8-f0cd211c3b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.705972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb12763-78c4-4d2d-beb8-f0cd211c3b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.707570 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb12763-78c4-4d2d-beb8-f0cd211c3b22 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.718288 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1429/2866] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 22:26:43.722337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.732854 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced86428-8529-4b46-aed7-9cea7528528e admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.737473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.738121 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.738437 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.738713 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] PATH_INFO: `/v3/projects/10a0b85d72774a19a14cafd6aa54b45f/users/a56534b7e7e548069efbfd65bd5309f1/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.753161 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a0b85d72774a19a14cafd6aa54b45f, user_id=a56534b7e7e548069efbfd65bd5309f1, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.755829 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.768928 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1438/2867] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:26:43 2022] PUT /identity/v3/projects/10a0b85d72774a19a14cafd6aa54b45f/users/a56534b7e7e548069efbfd65bd5309f1/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:43.780225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d79ec-184f-4e80-8f7a-da03122f39fd None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.780447 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d79ec-184f-4e80-8f7a-da03122f39fd None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.780732 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d79ec-184f-4e80-8f7a-da03122f39fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.807672 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-da3d79ec-184f-4e80-8f7a-da03122f39fd None None] MFA Rules not processed for user `a56534b7e7e548069efbfd65bd5309f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:43.808886 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-da3d79ec-184f-4e80-8f7a-da03122f39fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:43.870409 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1430/2868] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:43.884283 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:43.887789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:43.952439 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6eaf-a7f3-411d-81d2-a91180970a00 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:43.956068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049276c-fd62-4c14-83e0-1b688024bfdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:43.956674 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049276c-fd62-4c14-83e0-1b688024bfdc service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:43.956949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049276c-fd62-4c14-83e0-1b688024bfdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:43.957216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049276c-fd62-4c14-83e0-1b688024bfdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:43.965934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049276c-fd62-4c14-83e0-1b688024bfdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:43.967370 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049276c-fd62-4c14-83e0-1b688024bfdc service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:43.975940 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1439/2869] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:26:49.258531 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d79ec-184f-4e80-8f7a-da03122f39fd None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:49.288078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:49.320575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d79ec-184f-4e80-8f7a-da03122f39fd None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:49.325232 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:49.325993 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:49.326435 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:49.326815 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] PATH_INFO: `/v3/users/a56534b7e7e548069efbfd65bd5309f1` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:49.328114 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56534b7e7e548069efbfd65bd5309f1)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:49.330101 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:49.373406 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56534b7e7e548069efbfd65bd5309f1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.374072 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56534b7e7e548069efbfd65bd5309f1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.381284 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56534b7e7e548069efbfd65bd5309f1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.381907 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56534b7e7e548069efbfd65bd5309f1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.393690 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56534b7e7e548069efbfd65bd5309f1'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.405803 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1431/2870] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:26:49 2022] DELETE /identity/v3/users/a56534b7e7e548069efbfd65bd5309f1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:49.410390 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:49.410879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:49.410978 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:49.431093 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:49.432301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:49.491569 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1440/2871] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:49.502171 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:49.503589 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:49.561289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef2ab2-53b7-4c42-978d-e5419d92eb54 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:49.564914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e5b9-49a9-49ec-a71f-85fac4e6abb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:49.565527 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e5b9-49a9-49ec-a71f-85fac4e6abb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:49.565800 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e5b9-49a9-49ec-a71f-85fac4e6abb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:49.566069 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e5b9-49a9-49ec-a71f-85fac4e6abb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:49.574834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3e5b9-49a9-49ec-a71f-85fac4e6abb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:49.576245 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3e5b9-49a9-49ec-a71f-85fac4e6abb8 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:49.585401 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1432/2872] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:49.849883 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:49.851730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:49.861767 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:49.864949 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06514906-ea5a-46d2-b8aa-f5604b3026fd None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:49.872924 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:49.873823 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:49.874324 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:49.875050 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] PATH_INFO: `/v3/projects/10a0b85d72774a19a14cafd6aa54b45f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:49.877147 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a0b85d72774a19a14cafd6aa54b45f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:49.880144 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:49.927839 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a0b85d72774a19a14cafd6aa54b45f', 'request_id': 'req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.934894 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a0b85d72774a19a14cafd6aa54b45f', 'request_id': 'req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.940664 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a0b85d72774a19a14cafd6aa54b45f', 'request_id': 'req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.951413 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] The token cache is being invalidate because project 10a0b85d72774a19a14cafd6aa54b45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:26:49.951697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.952855 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-e37d19d5-b4a4-4d80-bb11-4b85e3547ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:49.954422 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1441/2873] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:49 2022] DELETE /identity/v3/projects/10a0b85d72774a19a14cafd6aa54b45f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:49.959399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ccdf0-5483-43b8-91d7-a786174001a5 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:49.959687 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ccdf0-5483-43b8-91d7-a786174001a5 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:49.959958 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ccdf0-5483-43b8-91d7-a786174001a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:49.979169 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-347ccdf0-5483-43b8-91d7-a786174001a5 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:49.980358 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-347ccdf0-5483-43b8-91d7-a786174001a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:50.024066 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:50.039889 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1433/2874] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:50.047819 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6addd4-eb39-4579-9dcf-2e7e5081d0e8 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.048105 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6addd4-eb39-4579-9dcf-2e7e5081d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.048385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6addd4-eb39-4579-9dcf-2e7e5081d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.067489 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-af6addd4-eb39-4579-9dcf-2e7e5081d0e8 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:50.068693 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-af6addd4-eb39-4579-9dcf-2e7e5081d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:50.076567 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1442/2875] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:50.081265 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ccdf0-5483-43b8-91d7-a786174001a5 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:50.090873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ccdf0-5483-43b8-91d7-a786174001a5 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:50.096221 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:50.096830 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.097110 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.097383 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.098073 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:26:50.098416 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:50.100018 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:50.111728 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1434/2876] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:26:50.115887 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6addd4-eb39-4579-9dcf-2e7e5081d0e8 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:50.125001 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6addd4-eb39-4579-9dcf-2e7e5081d0e8 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:50.129696 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:50.130328 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.130607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.130876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.131537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:50.133714 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:50.162461 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1443/2877] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:26:50 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:26:50.166730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:50.176483 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53191-15e1-40e0-bcee-5599214ef10a admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:50.232551 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:50.233127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.233419 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.233676 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.234372 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:50.236285 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:50.256853 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1435/2878] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:26:50 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 22:26:50.261203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:50.271885 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c5425-741e-4b6e-9129-9d2bc3e81d5b admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:50.276478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:50.277079 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.277357 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.277620 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.278337 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:50.279910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:50.290091 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1444/2879] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:50.293689 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:50.304048 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18e02-79f3-425d-ab40-f2c0bfe35bc6 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:50.308635 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcbe17-1c38-442d-bae6-42314ac82c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:50.309225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcbe17-1c38-442d-bae6-42314ac82c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.309500 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcbe17-1c38-442d-bae6-42314ac82c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.309771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcbe17-1c38-442d-bae6-42314ac82c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.310494 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcbe17-1c38-442d-bae6-42314ac82c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:50.312064 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcbe17-1c38-442d-bae6-42314ac82c2e admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:50.323261 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1436/2880] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:50.327255 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:50.336976 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ce4eb-3574-4374-b839-c221e371ff45 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:50.341512 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:50.342152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.342460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.342731 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] PATH_INFO: `/v3/projects/3c1b8f05e64447d7b6a99927bca4aa3f/users/bcf6359a1ce34a349fcb9fdd85dd44c8/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.357303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1b8f05e64447d7b6a99927bca4aa3f, user_id=bcf6359a1ce34a349fcb9fdd85dd44c8, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:50.360540 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:50.372848 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1445/2881] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:26:50 2022] PUT /identity/v3/projects/3c1b8f05e64447d7b6a99927bca4aa3f/users/bcf6359a1ce34a349fcb9fdd85dd44c8/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:26:50.384190 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909091e-8fea-4f17-9a17-c935a6b9f7b7 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.384470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909091e-8fea-4f17-9a17-c935a6b9f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.384741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909091e-8fea-4f17-9a17-c935a6b9f7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.411501 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-8909091e-8fea-4f17-9a17-c935a6b9f7b7 None None] MFA Rules not processed for user `bcf6359a1ce34a349fcb9fdd85dd44c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:50.412719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8909091e-8fea-4f17-9a17-c935a6b9f7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:50.474057 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1437/2882] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:50.485818 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:50.487619 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:50.548504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8730bc-eac7-4bee-9051-1caeac9075d5 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:50.552153 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da862b-1b91-4eac-b8fb-b1a733bf2baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:50.552761 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da862b-1b91-4eac-b8fb-b1a733bf2baf service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:50.553033 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da862b-1b91-4eac-b8fb-b1a733bf2baf service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:50.553301 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da862b-1b91-4eac-b8fb-b1a733bf2baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:50.561473 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da862b-1b91-4eac-b8fb-b1a733bf2baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:50.563879 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da862b-1b91-4eac-b8fb-b1a733bf2baf service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:50.572692 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1446/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:53.106793 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909091e-8fea-4f17-9a17-c935a6b9f7b7 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:53.154333 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:53.170184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909091e-8fea-4f17-9a17-c935a6b9f7b7 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:53.174682 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:53.175323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.175600 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.175872 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] PATH_INFO: `/v3/users/bcf6359a1ce34a349fcb9fdd85dd44c8` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.177021 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf6359a1ce34a349fcb9fdd85dd44c8)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:53.178968 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:53.223399 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf6359a1ce34a349fcb9fdd85dd44c8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.224036 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf6359a1ce34a349fcb9fdd85dd44c8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.230801 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf6359a1ce34a349fcb9fdd85dd44c8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.231433 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf6359a1ce34a349fcb9fdd85dd44c8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.243184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf6359a1ce34a349fcb9fdd85dd44c8'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.256212 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1438/2884] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:26:53 2022] DELETE /identity/v3/users/bcf6359a1ce34a349fcb9fdd85dd44c8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:53.260882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.261344 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.261478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.281178 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:53.282423 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:53.302216 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:53.341536 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1447/2885] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:53.351668 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:53.353053 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:53.409181 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c8a7c-ebbb-4c54-8435-0e5c89c1abd5 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:53.412747 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a8aa-bfab-4ddd-a02e-22f0b5fbfe3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:53.413351 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a8aa-bfab-4ddd-a02e-22f0b5fbfe3f service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.413624 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a8aa-bfab-4ddd-a02e-22f0b5fbfe3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.413890 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a8aa-bfab-4ddd-a02e-22f0b5fbfe3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.423379 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a8aa-bfab-4ddd-a02e-22f0b5fbfe3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:53.424789 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a8aa-bfab-4ddd-a02e-22f0b5fbfe3f service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:53.434657 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1439/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 22:26:53.699322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:53.700766 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:53.713251 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc7644-7048-48d9-b9c1-f1c9035f6f91 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:53.719186 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:53.720020 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.720295 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.720562 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] PATH_INFO: `/v3/projects/3c1b8f05e64447d7b6a99927bca4aa3f` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.721800 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1b8f05e64447d7b6a99927bca4aa3f)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:53.724425 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:53.773876 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1b8f05e64447d7b6a99927bca4aa3f', 'request_id': 'req-9662ec22-960e-440f-bd18-e03b58aabf23'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.781910 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1b8f05e64447d7b6a99927bca4aa3f', 'request_id': 'req-9662ec22-960e-440f-bd18-e03b58aabf23'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.787582 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1b8f05e64447d7b6a99927bca4aa3f', 'request_id': 'req-9662ec22-960e-440f-bd18-e03b58aabf23'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.798596 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] The token cache is being invalidate because project 3c1b8f05e64447d7b6a99927bca4aa3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:26:53.798904 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.799538 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-9662ec22-960e-440f-bd18-e03b58aabf23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:53.801026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1448/2887] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:53 2022] DELETE /identity/v3/projects/3c1b8f05e64447d7b6a99927bca4aa3f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:53.805890 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f97c3-9133-4ee5-a414-3e75289336ae None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.806179 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f97c3-9133-4ee5-a414-3e75289336ae None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.806484 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f97c3-9133-4ee5-a414-3e75289336ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.825254 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-a13f97c3-9133-4ee5-a414-3e75289336ae None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:53.826499 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a13f97c3-9133-4ee5-a414-3e75289336ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:53.887947 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1440/2888] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:53.896203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70560a1a-f62f-46a7-9010-594c6e8705ef None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.896471 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70560a1a-f62f-46a7-9010-594c6e8705ef None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.896747 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70560a1a-f62f-46a7-9010-594c6e8705ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.916822 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-70560a1a-f62f-46a7-9010-594c6e8705ef None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:53.918014 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-70560a1a-f62f-46a7-9010-594c6e8705ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:53.925812 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1449/2889] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:53.929923 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f97c3-9133-4ee5-a414-3e75289336ae None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:53.939526 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f97c3-9133-4ee5-a414-3e75289336ae None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:53.944074 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:53.944675 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.944953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.945226 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.945913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 22:26:53.946219 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:53.947817 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:53.950183 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:53.960972 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1441/2890] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Jul 28 22:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 22:26:53.964811 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70560a1a-f62f-46a7-9010-594c6e8705ef None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:53.974501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70560a1a-f62f-46a7-9010-594c6e8705ef None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:53.979072 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:53.979665 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:53.979938 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:53.980203 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:53.980844 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:53.982750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:54.009868 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1450/2891] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jul 28 22:26:53 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:26:54.013914 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:54.024156 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4105-3fae-429b-ae1b-1e58d8cf0ff7 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:54.078588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:54.079195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:54.079472 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:54.079742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:54.080387 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:54.082344 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:54.104089 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1442/2892] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 28 22:26:54 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 22:26:54.108588 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:54.118907 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11630-4f25-4918-af34-3cafa9534316 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:54.123502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:54.124626 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:54.124882 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:54.125148 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:54.125830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:54.127444 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:54.137509 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1451/2893] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:54.142001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:54.152049 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50031e-0b95-414a-ac03-a4fdfaef68d4 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:54.156727 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b1271-efd0-452b-bb91-66ae025ef9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:54.157359 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b1271-efd0-452b-bb91-66ae025ef9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:54.157669 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b1271-efd0-452b-bb91-66ae025ef9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:54.157885 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b1271-efd0-452b-bb91-66ae025ef9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:54.158594 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b1271-efd0-452b-bb91-66ae025ef9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:54.160172 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b1271-efd0-452b-bb91-66ae025ef9a9 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:54.170567 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1443/2894] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 22:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 22:26:54.174559 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:54.184308 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca027eb-b5d4-450a-a27d-d32aa817e679 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:54.189480 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:54.190122 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:54.190427 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:54.190697 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] PATH_INFO: `/v3/projects/3193e8595d7e4dee8795345f7fac30fb/users/e0197df1270442cc80737bb409275e25/roles/a56d5bfed1f74acdaacf5ccafad8ec18` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:54.205177 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3193e8595d7e4dee8795345f7fac30fb, user_id=e0197df1270442cc80737bb409275e25, role_id=a56d5bfed1f74acdaacf5ccafad8ec18)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:54.207830 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:54.219968 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1452/2895] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Jul 28 22:26:54 2022] PUT /identity/v3/projects/3193e8595d7e4dee8795345f7fac30fb/users/e0197df1270442cc80737bb409275e25/roles/a56d5bfed1f74acdaacf5ccafad8ec18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:54.229888 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614effa-a654-4947-9bb7-61d4e5cb53b3 None None] REQUEST_METHOD: `POST` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:54.230184 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614effa-a654-4947-9bb7-61d4e5cb53b3 None None] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:54.230479 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614effa-a654-4947-9bb7-61d4e5cb53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:54.257670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.auth.core [None req-2614effa-a654-4947-9bb7-61d4e5cb53b3 None None] MFA Rules not processed for user `e0197df1270442cc80737bb409275e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:54.259178 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-2614effa-a654-4947-9bb7-61d4e5cb53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:54.322652 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1444/2896] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:54.333901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:54.335632 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:54.387146 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:54.394901 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26261e-e23c-48c3-8bf6-4508ca9e5a29 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:54.399441 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d390-1d17-475b-a854-034d42a626aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fccb9c8b7ba54808ab77499297173498', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:54.400061 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d390-1d17-475b-a854-034d42a626aa service cinder] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:54.400342 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d390-1d17-475b-a854-034d42a626aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:54.400616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d390-1d17-475b-a854-034d42a626aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:54.409389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d390-1d17-475b-a854-034d42a626aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:54.410857 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d390-1d17-475b-a854-034d42a626aa service cinder] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:54.419623 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1453/2897] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:59.382588 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614effa-a654-4947-9bb7-61d4e5cb53b3 None None] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:59.445516 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614effa-a654-4947-9bb7-61d4e5cb53b3 None None] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:59.449880 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:59.450548 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:59.450825 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:59.451104 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] PATH_INFO: `/v3/users/e0197df1270442cc80737bb409275e25` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:59.452240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0197df1270442cc80737bb409275e25)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:59.454134 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:59.458606 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:26:59.501315 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0197df1270442cc80737bb409275e25'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:59.501969 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0197df1270442cc80737bb409275e25'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:59.510132 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0197df1270442cc80737bb409275e25'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:59.510784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0197df1270442cc80737bb409275e25'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:59.522615 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0197df1270442cc80737bb409275e25'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:26:59.535530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1445/2898] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:26:59 2022] DELETE /identity/v3/users/e0197df1270442cc80737bb409275e25 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:26:59.539977 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:59.540502 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:59.540612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:59.559522 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] MFA Rules not processed for user `f4a6891388094a448767f8355119febd`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:26:59.560756 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:59.619174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1454/2899] 10.222.0.48 () {58 vars in 958 bytes} [Thu Jul 28 22:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:26:59.628850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:59.630222 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:59.686819 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65982d1-c0f3-48ff-bb1d-f07e4ac316b3 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:26:59.690507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:26:59.691119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:26:59.691398 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:26:59.691670 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:26:59.700530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:26:59.701878 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:26:59.711950 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1446/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:26:59.983086 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:26:59.984544 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:26:59.996560 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a861f-2e66-48ac-a8d3-9807e556be12 None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:00.002339 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:00.002994 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:00.003303 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:00.003578 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] PATH_INFO: `/v3/projects/3193e8595d7e4dee8795345f7fac30fb` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:00.004750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3193e8595d7e4dee8795345f7fac30fb)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:00.007851 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:00.055914 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3193e8595d7e4dee8795345f7fac30fb', 'request_id': 'req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:00.064808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3193e8595d7e4dee8795345f7fac30fb', 'request_id': 'req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:00.070750 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3193e8595d7e4dee8795345f7fac30fb', 'request_id': 'req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:00.082052 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] The token cache is being invalidate because project 3193e8595d7e4dee8795345f7fac30fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:27:00.082382 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:00.083010 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-a64b7302-78cd-4b2a-8d65-a63f8c425e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:00.084513 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1455/2901] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:26:59 2022] DELETE /identity/v3/projects/3193e8595d7e4dee8795345f7fac30fb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:27:09.707698 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:27:10.078537 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:27:35.077836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:27:35.080715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:35.200281 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fef31-b503-405d-bd5a-3f39ea1758e9 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:35.294059 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:35.294943 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:35.296963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:35.296963 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:35.298119 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:35.320028 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:35.322099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:35.335486 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1447/2902] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:27:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:27:42.716595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] REQUEST_METHOD: `POST` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:42.717094 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:42.717197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:42.736460 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.auth.core [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] MFA Rules not processed for user `61cbae3b43bc49e1a221be07f06a57f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 22:27:42.738260 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:42.791302 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1456/2903] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 28 22:27:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 22:27:42.836019 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:27:42.837403 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:42.905857 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674007f1-c1ae-4762-bc55-7a3d5c714ccb service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:42.911227 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92ef4880fa1f413c8f553ebee43d4c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:42.911836 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:42.912115 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:42.912386 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:42.921850 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:42.923625 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:42.932331 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1448/2904] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 28 22:27:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 22:27:46.292757 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:27:46.294941 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:46.389769 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5596cd-f3b7-495a-8d4d-16f6bb83a79b None None] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:46.395656 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:46.396313 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:46.396595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:46.396870 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:46.398799 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:46.411496 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:46.413109 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:46.427174 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1457/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:27:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:27:49.228428 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:27:49.229913 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:49.249162 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=100 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:27:49.300414 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000972-0dbb-4da5-8707-a6a0c0ce01d7 service swift] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:49.304855 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:49.305485 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:49.305760 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:49.306024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] PATH_INFO: `/v3/users/9bab35b69c92496ba7d3a9bbe33324fe` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:49.307291 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bab35b69c92496ba7d3a9bbe33324fe)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:49.309202 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:49.356920 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bab35b69c92496ba7d3a9bbe33324fe'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.357572 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bab35b69c92496ba7d3a9bbe33324fe'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.364369 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bab35b69c92496ba7d3a9bbe33324fe'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.365010 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bab35b69c92496ba7d3a9bbe33324fe'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.376655 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bab35b69c92496ba7d3a9bbe33324fe'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.389540 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1449/2906] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:27:49 2022] DELETE /identity/v3/users/9bab35b69c92496ba7d3a9bbe33324fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:27:49.561629 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:27:49.573064 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eed8c-c03c-43fc-b0ed-04e5df277509 service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:49.628862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:49.629504 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:49.629789 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:49.630065 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] PATH_INFO: `/v3/projects/029af963b2db4473a1b3969ed5abf407` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:49.631272 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029af963b2db4473a1b3969ed5abf407)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:49.633164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:49.674197 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:27:49.683309 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029af963b2db4473a1b3969ed5abf407', 'request_id': 'req-046f66fb-39cc-4967-8628-3d92d0b8fa47'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.690995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029af963b2db4473a1b3969ed5abf407', 'request_id': 'req-046f66fb-39cc-4967-8628-3d92d0b8fa47'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.696490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029af963b2db4473a1b3969ed5abf407', 'request_id': 'req-046f66fb-39cc-4967-8628-3d92d0b8fa47'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.707720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] The token cache is being invalidate because project 029af963b2db4473a1b3969ed5abf407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:27:49.708003 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.708612 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.710172 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1458/2907] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:27:49 2022] DELETE /identity/v3/projects/029af963b2db4473a1b3969ed5abf407 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:27:49.714099 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:27:49.715645 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:49.728710 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce70ed-5b4c-440e-8b70-e541f6b77384 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:49.783307 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:49.783938 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:49.784244 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:49.784525 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] PATH_INFO: `/v3/users/88154e80600d4671b699a73545c7bf99` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:49.785688 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88154e80600d4671b699a73545c7bf99)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:49.787626 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:49.824323 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:27:49.835742 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88154e80600d4671b699a73545c7bf99'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.836388 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88154e80600d4671b699a73545c7bf99'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.843458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88154e80600d4671b699a73545c7bf99'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.844085 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88154e80600d4671b699a73545c7bf99'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.855530 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88154e80600d4671b699a73545c7bf99'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:49.868575 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1450/2908] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:27:49 2022] DELETE /identity/v3/users/88154e80600d4671b699a73545c7bf99 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:27:50.037862 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:27:50.039343 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:27:50.054825 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f66fb-39cc-4967-8628-3d92d0b8fa47 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:27:50.112840 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:27:50.114154 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:27:50.114720 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:27:50.115132 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] PATH_INFO: `/v3/projects/3683af3a9b9349fbb61c4610a7eba691` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:27:50.116660 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3683af3a9b9349fbb61c4610a7eba691)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:27:50.119156 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:27:50.167609 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3683af3a9b9349fbb61c4610a7eba691', 'request_id': 'req-0e402d19-a5c2-4150-9c32-329f098b2281'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:50.174676 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3683af3a9b9349fbb61c4610a7eba691', 'request_id': 'req-0e402d19-a5c2-4150-9c32-329f098b2281'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:50.180759 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3683af3a9b9349fbb61c4610a7eba691', 'request_id': 'req-0e402d19-a5c2-4150-9c32-329f098b2281'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:50.191983 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] The token cache is being invalidate because project 3683af3a9b9349fbb61c4610a7eba691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80488) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:27:50.192270 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:50.192891 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:27:50.194426 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1459/2909] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:27:50 2022] DELETE /identity/v3/projects/3683af3a9b9349fbb61c4610a7eba691 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:27:59.865240 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:28:00.188987 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:18.536662 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:29:18.538056 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:18.605763 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be671-49ac-4ed7-970a-f8ba22c54100 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:29:18.663824 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:29:18.664439 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:29:18.664716 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:29:18.664987 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:29:18.666752 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:18.677583 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:29:18.679180 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:29:18.688873 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1451/2910] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:29:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:29:20.384533 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:29:20.386198 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:20.446979 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e402d19-a5c2-4150-9c32-329f098b2281 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:29:20.450934 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:29:20.451553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:29:20.451836 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:29:20.452108 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:29:20.453881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:20.464506 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:29:20.466019 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:29:20.474741 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1460/2911] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:29:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:29:20.566199 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:29:20.568393 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:20.579951 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45fb1b-b99f-4561-a9b7-0662feee364b service placement] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:29:20.583557 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:29:20.584164 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:29:20.584445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:29:20.584719 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:29:20.586445 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:20.658724 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:29:20.660155 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:29:20.671078 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1452/2912] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:29:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:29:20.731226 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:29:20.732616 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:20.747722 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377518e-11c5-4893-b395-7e1f729a6fbd service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:29:20.752598 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:29:20.753199 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:29:20.753478 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:29:20.753749 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:29:20.755995 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:20.767257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:29:20.768808 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:29:20.778881 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1461/2913] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:29:21.165318 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:29:21.166977 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:21.184274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a1e1-4078-4357-9358-6b0e622b6d98 service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:29:21.190618 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:29:21.191231 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:29:21.191507 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:29:21.191771 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:29:21.193617 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:29:21.206071 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:29:21.207692 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:29:21.219423 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1453/2914] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:29:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:29:30.774408 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=32 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:29:31.214470 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=98 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:13.427389 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:13.436792 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316671-c34f-43ac-957f-4d1805398b79 service placement] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:13.440951 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:13.441553 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:13.441833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:13.442103 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:13.443959 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:13.502135 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:13.503600 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:13.512727 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1462/2915] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:31:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:31:14.356739 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:14.358882 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:14.375787 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3155831-25d0-4999-b236-f26d72f2f8f5 service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:14.381856 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0b530da35f445d8241c16d8f51b16b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:14.382715 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:14.383127 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:14.383467 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:14.385904 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:14.400268 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:14.401946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:14.413490 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1454/2916] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:31:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:31:14.550466 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:14.560815 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3389a-61e5-4fd2-8530-a9c9ec09087d service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:14.565164 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:14.565833 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:14.566114 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:14.566433 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:14.568298 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:14.583521 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:14.584980 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:14.605136 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1463/2917] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:31:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:31:15.795225 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:15.806807 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630fc09-fc1c-49bd-9d3c-d0c0da3b1ead service nova] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:15.810385 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:15.811001 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:15.811274 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:15.811544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:15.813784 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:15.827277 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:15.829316 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:15.840279 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1455/2918] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:31:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:31:18.618330 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:18.627098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ef452-ad10-4326-9dba-4cb67446c20a service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:18.630738 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba7594ae41184fb09cd2399b7f35616e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:18.631346 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:18.631625 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:18.631896 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:18.633643 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:18.697025 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:18.698385 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:18.710490 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1464/2919] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:31:21.525025 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:21.527706 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:21.544458 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee156f-dbb8-4a23-9763-28fd6a4f8a2a service neutron] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:21.549519 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:21.550144 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] REQUEST_METHOD: `GET` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:21.550453 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:21.550734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:21.552505 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:21.564741 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:21.566753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:21.578289 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1456/2920] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:31:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:31:24.667278 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:24.669044 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:24.682107 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d5361-bc0d-457f-9fe3-a67c5c4d2a14 service neutron] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:24.692997 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:24.693652 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:24.693936 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:24.694322 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] PATH_INFO: `/v3/users/879d69c60bdc4d049fb3e782fa17306a` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:24.695501 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879d69c60bdc4d049fb3e782fa17306a)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:24.697587 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:24.745702 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879d69c60bdc4d049fb3e782fa17306a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:24.746644 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879d69c60bdc4d049fb3e782fa17306a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:24.756004 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879d69c60bdc4d049fb3e782fa17306a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:24.770098 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879d69c60bdc4d049fb3e782fa17306a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:24.778452 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:24.786059 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879d69c60bdc4d049fb3e782fa17306a'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:24.793438 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1465/2921] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:31:24 2022] DELETE /identity/v3/users/879d69c60bdc4d049fb3e782fa17306a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:31:24.975788 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:24.986805 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa4064-4445-4441-ba89-74898b5d2fca service placement] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:25.057039 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:25.057696 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:25.058455 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:25.058730 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] PATH_INFO: `/v3/projects/8be594ef5f3c43ac93450210475b6124` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:25.059865 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be594ef5f3c43ac93450210475b6124)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:25.062272 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:25.107457 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be594ef5f3c43ac93450210475b6124', 'request_id': 'req-60392f3a-be68-4386-af64-27a0f99d9f56'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.113506 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be594ef5f3c43ac93450210475b6124', 'request_id': 'req-60392f3a-be68-4386-af64-27a0f99d9f56'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.118864 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be594ef5f3c43ac93450210475b6124', 'request_id': 'req-60392f3a-be68-4386-af64-27a0f99d9f56'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.131544 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] The token cache is being invalidate because project 8be594ef5f3c43ac93450210475b6124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:31:25.131834 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.132451 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.133953 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1457/2922] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:31:24 2022] DELETE /identity/v3/projects/8be594ef5f3c43ac93450210475b6124 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 22:31:25.138221 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:25.139746 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:25.153335 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba41401-4197-48ac-88a8-d32016bd7e42 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:25.215607 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:25.216257 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:25.216595 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:25.217097 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] PATH_INFO: `/v3/users/50e6f14405cd481290c45d533f780538` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:25.218935 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e6f14405cd481290c45d533f780538)` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:25.220784 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:25.266068 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e6f14405cd481290c45d533f780538'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.266730 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e6f14405cd481290c45d533f780538'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.273424 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e6f14405cd481290c45d533f780538'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.280179 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e6f14405cd481290c45d533f780538'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.291662 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.notifications [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e6f14405cd481290c45d533f780538'} {{(pid=80488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.298170 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1466/2923] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 22:31:25 2022] DELETE /identity/v3/users/50e6f14405cd481290c45d533f780538 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:31:25.467948 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Authenticating user token {{(pid=80487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:31:25.469374 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.fernet_utils [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:31:25.482946 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60392f3a-be68-4386-af64-27a0f99d9f56 admin admin] Validating token access rules against request {{(pid=80487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:31:25.532303 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:25.543549 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a6891388094a448767f8355119febd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8855a1173a1b45fb8e20b8571862d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:31:25.544195 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:31:25.544477 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:31:25.544753 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] PATH_INFO: `/v3/projects/aa1e8d8c08804ac8a0ff5bda43ed6b73` {{(pid=80487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:31:25.545906 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1e8d8c08804ac8a0ff5bda43ed6b73)` {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:31:25.548489 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] RBAC: Authorization granted {{(pid=80487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:31:25.592781 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1e8d8c08804ac8a0ff5bda43ed6b73', 'request_id': 'req-02d1a9f5-4097-4121-a462-feb5afa9d27c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.599520 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1e8d8c08804ac8a0ff5bda43ed6b73', 'request_id': 'req-02d1a9f5-4097-4121-a462-feb5afa9d27c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.605124 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1e8d8c08804ac8a0ff5bda43ed6b73', 'request_id': 'req-02d1a9f5-4097-4121-a462-feb5afa9d27c'} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.618734 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] The token cache is being invalidate because project aa1e8d8c08804ac8a0ff5bda43ed6b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 22:31:25.619024 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.619650 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG keystone.notifications [None req-02d1a9f5-4097-4121-a462-feb5afa9d27c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 22:31:25.621135 dv-cinder-850939-3-smb devstack@keystone.service[80487]: [pid: 80487|app: 0|req: 1458/2924] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 22:31:25 2022] DELETE /identity/v3/projects/aa1e8d8c08804ac8a0ff5bda43ed6b73 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 22:31:35.293966 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=56,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:31:35.614629 dv-cinder-850939-3-smb devstack@keystone.service[80487]: DEBUG dbcounter [-] [80487] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 22:35:16.243200 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Authenticating user token {{(pid=80488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 22:35:16.244613 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:35:16.382349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2caa99-b3f3-4b76-b40c-3fad421ea3b6 admin admin] Validating token access rules against request {{(pid=80488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 22:35:16.439415 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef1722-fe09-40e1-bd82-7b6902e74da0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cd150c9bbd648feb1a2688397c3bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '351b3a08fcec462b94afa05f64f16ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 22:35:16.440026 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef1722-fe09-40e1-bd82-7b6902e74da0 service placement] REQUEST_METHOD: `GET` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 22:35:16.440304 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef1722-fe09-40e1-bd82-7b6902e74da0 service placement] SCRIPT_NAME: `/identity` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 22:35:16.440571 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef1722-fe09-40e1-bd82-7b6902e74da0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 22:35:16.442349 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.fernet_utils [None req-fdef1722-fe09-40e1-bd82-7b6902e74da0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 22:35:16.453323 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef1722-fe09-40e1-bd82-7b6902e74da0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 22:35:16.454906 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef1722-fe09-40e1-bd82-7b6902e74da0 service placement] RBAC: Authorization granted {{(pid=80488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 22:35:16.465152 dv-cinder-850939-3-smb devstack@keystone.service[80488]: [pid: 80488|app: 0|req: 1467/2925] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 28 22:35:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 22:35:26.460493 dv-cinder-850939-3-smb devstack@keystone.service[80488]: DEBUG dbcounter [-] [80488] Writing DB stats keystone:SELECT=89 {{(pid=80488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}